Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2024 Augustjdefr89

About whether AI is losing hype and people testing LLMs on basic arithmetic.

It’s hilarious seeing people getting LLMs to traditional takes traditional discrete algorithms do perfectly already. “Let’s use LLM to do basic arithmetic!” Like, that’s not what they are built for. We want more generalization… So much to unpack here and I’m tired of having to explain these basic things. You will know our models got more powerful if they can do something like solve the ARC challenge, not cramming it with new updated information we know it will already process a certain way…

An AI model solves the ARC challenge.

Has this happened?

Yes 55 (47%)Not sure 53 (45%)No 9 (8%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.