About whether GPT-written tests passing on the first try shows they are good tests.
Has this happened?
Yes 89 (78%)Not sure 18 (16%)No 7 (6%)
Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.
Hacker News has set AI a lot of challenges over the years. Which ones has it met?
About whether GPT-written tests passing on the first try shows they are good tests.
Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.
I'd be impressed if AI wrote a test suite that immediately found a bunch of valid bugs. I'd be nonplussed if it wrote a test suite that "passed" on the first try. The presence of passing tests does not imply an absence of bugs, and the hard part of developing a test suite is the test design, not the implementation.