Goalposts

Hacker News has set AI a lot of challenges over the years. Which ones has it met?

2025 Mayjdefr89

About an AI agent startup that automatically finds bugs in pull requests.

Ton of work already being done on this. I am a Vulnerability Researcher @ MIT and I know of a few efforts, just at my lab alone, being worked on. So far nearly everything I have seen seems to do nothing but report false positives. They are missing bugs a fuzzer could have found in minutes. I will be impressed when it finds high severity/exploitable bugs. I think we are a bit too far from that if its achievable though. On the flip side LLMs have been very useful reverse engineering binaries. Binary Ninja w/ Sidekick (their LLM plugin) can recover and name data structures quite well. It saves a ton of time. Also does a decent job providing high level overviews of code...

AI bug-finding tools find high-severity, exploitable bugs in code.

Has this happened?

Yes 98 (94%)Not sure 4 (4%)No 2 (2%)

Votes cast 1–2 October 2026: 100,590 votes from 9,694 people.