Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2023 DecembergalaxyLogic

About Gemini Pro failing a puzzle about how many sisters a girl has.

Each of those brothers have Kaley as sister because they are her brothers. Now assuming they all have the same 2 sisters, then any sister that Kaley has would need to be one of them, so Kaley would have one sister.

But what if each of the brothers have a different mother or father than the the rest of the group does? Kaley could then have any number of sisters none of which would be shared with her brothers. So what is the correct answer?

So this is tricky even for real intelligence. The problem with the AI seems to be that it cannot explain its incorrect reasoning (because it doesn't do reasoning, only statistical matching) and thus cannot realize that it has the wrong answer.

An AI that gives a wrong answer to a logic puzzle explains its reasoning and realizes the answer is wrong.

Has this happened?

Yes 77 (60%)Not sure 30 (23%)No 21 (16%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.