Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2025 Marchthedangler

About comparing Gemini 2.5 Pro and Claude 3.7 Sonnet on coding tasks.

I still can't get any LLM to use my niche API and build out API REST requests for all the endpoints. It just makes stuff up even though it knows the api documentation. As soon as one can do that, I'll be sold. until then I feel like its all coding problems its seen in github or source code somewhere.

An LLM correctly builds REST requests for every endpoint of a niche API from its documentation, without making things up.

Has this happened?

Yes 77 (65%)Not sure 29 (24%)No 13 (11%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.