Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2023 Januaryrandom_upvoter

About whether ChatGPT-written essays harm education and how deep its knowledge really runs.

ChatGPT's knowledge doesn't run that deep. If ChatGPT can write a credible essay about a given subject it means your subject was rather generic to begin with.

I was playing a bit with ChatGPT and I wondered how much actual knowledge could be stored in that model. So I asked ChatGPT whether it knew the song by Franz Schubert called "Am Feierabend" and if so, if it could tell me the subject/meaning of the song. "Certainly I know this song", responded ChatGPT and then gave me -- with total confidence -- a completely wrong answer about the meaning of the song. In fact I was a bit baffled by the authority with which is spouted this nonsense answer. A truly intelligent system would be aware about the limits its knowledge, right?

So I think that with a minimum of creativity teachers can come up with questions that can easily stump ChatGPT.

An AI recognizes the limits of its knowledge instead of confidently giving wrong answers to obscure questions.

Has this happened?

Yes 40 (31%)Not sure 20 (16%)No 67 (53%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.