Tech
A Green Suite Can Still Lie: Mutation-Test Your Fixtures Before You Trust an Agent Patch
An agent patch can pass every fixture in your repository and still be wrong. The fixtures are part of the oracle, and fixtures can be lazy. If the expected value in a fixture never changes, the suite can approve code that breaks exactly the case the fixture forgot.
This is a three-phase probe for evaluating agent-generated patches. Phase 1 runs property checks before anything else. Phase 2 mutates fixtures to prove they can fail. Phase 3 freezes flaky tests only after the first two phases pas...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to