Goalposts

This would seem to lead to absurd implications. What if in, say, 20 years, an AI is able to independently prove nearly everything important in under an hour, including the Riemann hypothesis, with no contamination from other proofs? (Let's say it's also free to write and run arbitrary code, as well.)

Whether it's 5, 10, 20, 50 years, obviously the takeaway cannot be "something had gone terribly wrong". The takeaway would be the smartest humans were never close to the theoretical intelligence and wisdom ceiling and never could've been. This will one day seem obvious in retrospect. There's no reason evolution by natural selection would've landed any species near such a ceiling.