Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2024 Januaryint_19h

About whether open models rival GPT-3.5, after an amateur's 7B model topped leaderboards.

Note that it only includes gpt-3.5-turbo (the current iteration), not the original gpt-3.5. It's not exactly a secret that "turbo" models are noticeably dumber than the originals, whatever OpenAI says. There's no free lunch - that's why it's so much cheaper and faster...

That said, we do have public 120b models now that genuinely feel better than the original gpt-3.5.

The holy grail remains beating gpt-4 (or even gpt-4-turbo). This seems to be out of reach on consumer hardware at least...

A public model running on consumer hardware beats GPT-4.

Has this happened?

Yes 89 (71%)Not sure 28 (22%)No 9 (7%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.