Goalposts

I wouldn't be surprised if the real way we reached AGI was that the cat and mouse game between people trying to detect AI and people trying to sneak AI output past detection. That is essentially a hyper-analytic version of the Turing test - if humanity as a whole cannot discern human output from AI output given all the tools of science at its disposal, then we have failed to prove that it isn't intelligent, which is really more of a scientific question formulation anyhow.

If you think about it, it's sort of like a real life GAN algorithm.