Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2024 JulyVincentEvans

About whether tokenization excuses LLMs failing to count letters in "strawberry".

Indeed, I appreciate the explanation, it is certainly both interesting and informative to me, but to somewhat echo the person you are replying to - if I wanted a boat, and you offer me a boat, and it doesn’t float - the reasons for failure are perhaps full of interesting details, but perhaps the most important thing to focus on first - is to make the boat float, or stop offering it to people who are in need of a boat.

To paraphrase how this thread started - it was someone testing different boats to see whether they can simply float - and they couldn’t. And the reply was questioning the validity of testing boats whether they can simply float.

At least this is how it sounds to me when I am told that our AI overlords can’t figure out how many Rs are in the word “strawberry”.

An AI reliably counts how many Rs are in the word "strawberry".

Has this happened?

Yes 82 (69%)Not sure 25 (21%)No 12 (10%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.