Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2025 MayModernMech

About whether Claude 4 in Copilot can automate package upgrades and maintenance of old projects.

That's kind of my benchmark for whether or not these models are useful. I've got a project that needs some extensive refactoring to get working again. Mostly upgrading packages, but also it will require updating the code to some new language semantics that didn't exist when it was written. So far, current AI models can make essentially zero progress on this task. I'll keep trying until they can!

An AI upgrades an old project's packages and updates its code to new language semantics so it works again.

Has this happened?

Yes 93 (82%)Not sure 17 (15%)No 4 (4%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.