Tag See all →

#ai-coding

2 stories

Banner: an AI agent's feature passed all its own tests and was wrong in production because the tests encoded the bug

AI & Machine Learning Bug Report

An AI agent's feature passed all its own tests and failed in production: the tests encoded the bug

Aarav Mehta · Jul 22, 2025 · 7 min read

A coding agent implemented a discount rule and wrote tests for it. Everything was green, the review looked fine, and production applied the discount to the wrong orders. The agent had written tests from its own implementation, so they asserted the bug. How we changed the workflow so humans own the acceptance criteria.

Banner: AI-suggested dependency that did not exist and was later registered by someone else

Security Bug Report

AI-suggested Python package that never existed: catching slopsquatting in CI

Ryan Pham · Jun 11, 2025 · 7 min read

A pull request added a dependency that an AI assistant had suggested. The package name did not exist when the code was written, and a few weeks later someone else published it. We caught it in review by luck, then added registry checks so we do not rely on luck.