Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2025 Marchjamal-kumar

About Erlang versus Elixir, and how well LLMs handle Elixir code.

Oh boy. One of the things I have been doing to test if an LLM is 'there yet' by my standards is if it can spit out solutions in elixir without hallucinating packages that don't exist to get the job done. Since I haven't tested since chatgpt 4 came out I dunno where it's at for that but always felt like a decent litmus test.

An LLM writes Elixir solutions without hallucinating packages that don't exist.

Has this happened?

Yes 57 (46%)Not sure 58 (47%)No 8 (7%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.