Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2023 Januarypurpleblue

About whether a GPT-3-like model trained on astronomy research could explain anomalies.

If you give GPT3 code with a bug in it, and ask it to find the bug, it can't really do that. I'm pretty sure giving it all the data and asking it why things aren't working the way it should, it wouldn't have actual knowledge.

There's a depth to explaining things that GPT still can't do. It's still astonishing, and has completely changed my idea on what AI can do, like write plays with very incredible context (better than most humans!) but there are still major limits.

Given code with a bug in it, an AI like GPT finds the bug when asked.

Has this happened?

Yes 122 (91%)Not sure 9 (7%)No 3 (2%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.