About how to measure progress toward artificial general intelligence with benchmarks.
Has this happened?
Yes 51 (42%)Not sure 29 (24%)No 41 (34%)
Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.
Hacker News has set AI a lot of challenges over the years. Which ones has it met?
About how to measure progress toward artificial general intelligence with benchmarks.
Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.
It’s very difficult to come up with an objective metric or benchmark for general AI that can’t be gamed, or which won’t turn out to be disappointingly easy. It makes sense that most research would be in the direction of tasks which are easily quantifiable. More hazy benchmarks like the Turing test are possibly better but that one in particular isn’t so good unless it’s enhanced (I’d say a 1 hour conversation with an AI posing as someone with graduate-student level understanding of a field of science or art I know something about would be adequate proof, but maybe I’m being naive).