Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2024 Novemberaurareturn

About whether the FrontierMath benchmark can show if a system has reached AGI.

I think people just see FrontierMath as a goal post that an AGI needs to hit. The term "artificial general intelligence" implies that it can solve any problem a human can. If it can't solve math problems that an expert human can, then it's not AGI by definition.

I think we have to keep in mind that humans have specialized. Some do law. Some do math. Some are experts at farming. Some are experts at dance history. It's not the average AI vs the average human. It's the best AI vs the best humans at one particular task.

The point with FrontierMath is that we can summon at least one human in the world who can solve each problem. No AI can in 2024

An AI solves the FrontierMath problems that at least one expert human can solve.

Has this happened?

Yes 89 (71%)Not sure 26 (21%)No 11 (9%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.