Sponsored Content

DEV Community

Finley Zhou profile picture

Finley Zhou

Backend developer who loves Rust and distributed systems.

Location Tokyo, Japan Joined Joined on 
One Command to Verify an Agent Patch: Seeded Hypothesis, Fixture Contracts, and a TTL Quarantine

One Command to Verify an Agent Patch: Seeded Hypothesis, Fixture Contracts, and a TTL Quarantine

1
Comments
4 min read
A Patch Triage Matrix: Which Tests Actually Matter for an Agent's Diff?

A Patch Triage Matrix: Which Tests Actually Matter for an Agent's Diff?

Comments
4 min read
Replay Yesterday's Bugs to Test Today's Agent-Patch Gate

Replay Yesterday's Bugs to Test Today's Agent-Patch Gate

Comments
4 min read
A Run Budget for Agent Patch Verification: Stop Rechecking Until Green

A Run Budget for Agent Patch Verification: Stop Rechecking Until Green

Comments
4 min read
A Verification Pipeline for Agent Patches: Property Checks, Fixture Pins, and a Flaky Freeze in One YAML

A Verification Pipeline for Agent Patches: Property Checks, Fixture Pins, and a Flaky Freeze in One YAML

Comments
4 min read
Legacy Code Night Shift: Drafting a Living API Contract with a Free Model and a Free Server

Legacy Code Night Shift: Drafting a Living API Contract with a Free Model and a Free Server

Comments
5 min read
Auditing Agent Patches: Property Checks, Fixture Locks, and Expiring Flaky Freezes

Auditing Agent Patches: Property Checks, Fixture Locks, and Expiring Flaky Freezes

2
Comments 1
4 min read
A Green Suite Can Still Lie: Mutation-Test Your Fixtures Before You Trust an Agent Patch

A Green Suite Can Still Lie: Mutation-Test Your Fixtures Before You Trust an Agent Patch

Comments
4 min read
A Zero-Budget Verification Layer for Agent Patches: Compile, Property, and Bound Before Merge

A Zero-Budget Verification Layer for Agent Patches: Compile, Property, and Bound Before Merge

Comments
6 min read
The Patch Passed All Tests. The Error Contract Didn't.

The Patch Passed All Tests. The Error Contract Didn't.

Comments
4 min read
Fixture Drift: Why Agent Patches Pass Green Tests and Break Production

Fixture Drift: Why Agent Patches Pass Green Tests and Break Production

Comments
4 min read
Three Independent Checks for an Agent Patch: Fixture Contract, Reference Oracle, and a Flaky Quarantine

Three Independent Checks for an Agent Patch: Fixture Contract, Reference Oracle, and a Flaky Quarantine

Comments
4 min read
Give Your Agent Patch a Determinism Budget: Seed-Locked Properties, Pinned Fixtures, a Freeze Registry

Give Your Agent Patch a Determinism Budget: Seed-Locked Properties, Pinned Fixtures, a Freeze Registry

Comments
4 min read
Free Tokens, Free Server, and a Property Test That Refuses to Be Gamed

Free Tokens, Free Server, and a Property Test That Refuses to Be Gamed

Comments
5 min read
Three Buckets and a Freeze: A Testing Triage for Agent Patches That Don't Trust the Patch

Three Buckets and a Freeze: A Testing Triage for Agent Patches That Don't Trust the Patch

Comments
5 min read
Unit Tests Approve. The Invariant Disagrees: A Property-First Strategy for Agent Patches

Unit Tests Approve. The Invariant Disagrees: A Property-First Strategy for Agent Patches

Comments
4 min read
The Patch That Slowed Everything Down: How to Benchmark Agent Changes on a Free Server

The Patch That Slowed Everything Down: How to Benchmark Agent Changes on a Free Server

Comments
5 min read
GCC Passed, Clang Didn't: A Four-Configuration Compile Matrix for Agent Patches

GCC Passed, Clang Didn't: A Four-Configuration Compile Matrix for Agent Patches

Comments
6 min read
Freeze the Flaky, Check the Properties: A Three-Layer Test Strategy for Agent Patches

Freeze the Flaky, Check the Properties: A Three-Layer Test Strategy for Agent Patches

Comments
3 min read
Freeze Flaky Tests, Don't Retry Them: A Three-Layer Test Strategy for Agent Patches

Freeze Flaky Tests, Don't Retry Them: A Three-Layer Test Strategy for Agent Patches

Comments
4 min read
Compiler Fences: A C++ Sanitizer Workflow for AI-Generated Patches

Compiler Fences: A C++ Sanitizer Workflow for AI-Generated Patches

Comments
5 min read
Properties First, Fixtures Second, Flakes Never: A Test Contract for Agent Patches

Properties First, Fixtures Second, Flakes Never: A Test Contract for Agent Patches

Comments
5 min read
The Test Failed, Passed, Failed. The Agent "Fixed" a Function That Was Already Correct.

The Test Failed, Passed, Failed. The Agent "Fixed" a Function That Was Already Correct.

Comments
4 min read
The Gate Said No. Now What? A Triage Procedure for Rejected Agent Patches

The Gate Said No. Now What? A Triage Procedure for Rejected Agent Patches

Comments
5 min read
Frequency Beats Order: A Token-Saving Triage for C++ Build Logs

Frequency Beats Order: A Token-Saving Triage for C++ Build Logs

Comments
6 min read
Free Compute First: A Cost-Capped Triage Gate for Agent Patches

Free Compute First: A Cost-Capped Triage Gate for Agent Patches

Comments
5 min read
Diff the Behavior, Not the Code: A Differential Gate for Agent Patches

Diff the Behavior, Not the Code: A Differential Gate for Agent Patches

Comments
5 min read
9/9 Agent Tests Passed. The Trace Oracle Flagged 4 Behavior Changes.

9/9 Agent Tests Passed. The Trace Oracle Flagged 4 Behavior Changes.

Comments
6 min read
An Agent Patch Is a Hypothesis. Test It Like One.

An Agent Patch Is a Hypothesis. Test It Like One.

1
Comments 1
5 min read
The Gate Rejected Nothing. So I Injected 40 Bugs to See If It Could.

The Gate Rejected Nothing. So I Injected 40 Bugs to See If It Could.

5
Comments 2
5 min read
Can Your Agent Patch Gate Reject Anything? Run a Mutation Audit and Find Out.

Can Your Agent Patch Gate Reject Anything? Run a Mutation Audit and Find Out.

Comments
6 min read
The Real Cost of 'Free' AI: A Budgeted Patch Loop for Agent-Written Code

The Real Cost of 'Free' AI: A Budgeted Patch Loop for Agent-Written Code

Comments
5 min read
The Formatter Looked Clean. Property Testing Found the Missing Zeroes.

The Formatter Looked Clean. Property Testing Found the Missing Zeroes.

Comments
5 min read
Agent Patches Pass Their Own Tests. Here's the Three-Layer Gate That Doesn't Trust Them.

Agent Patches Pass Their Own Tests. Here's the Three-Layer Gate That Doesn't Trust Them.

Comments
6 min read
The Agent Patch Gate: Properties, Fixtures, and a Flake Freeze

The Agent Patch Gate: Properties, Fixtures, and a Flake Freeze

Comments
4 min read
Agent Patches Need a Test Contract: Properties, Fixtures, and a Quarantine

Agent Patches Need a Test Contract: Properties, Fixtures, and a Quarantine

Comments
5 min read
Agent Patches Get Three Gates: Property Checks, Pinned Fixtures, and a Flaky Freeze

Agent Patches Get Three Gates: Property Checks, Pinned Fixtures, and a Flaky Freeze

Comments
4 min read
Properties, Fixtures, and a Flaky Freeze: A Three-Layer Gate for Agent Patches

Properties, Fixtures, and a Flaky Freeze: A Three-Layer Gate for Agent Patches

Comments
6 min read
Before You Trust an Agent Patch: Properties, Fixtures, and a Flaky Freeze

Before You Trust an Agent Patch: Properties, Fixtures, and a Flaky Freeze

Comments
5 min read
The Agent Patch Test Budget: Spend CI Minutes Where They Catch Faults

The Agent Patch Test Budget: Spend CI Minutes Where They Catch Faults

Comments
4 min read
The Flaky Freeze Needs an Expiry Date: A Gate Runner for Agent Patches

The Flaky Freeze Needs an Expiry Date: A Gate Runner for Agent Patches

Comments
6 min read
Mutate the Agent's Patch Before You Trust Its Tests

Mutate the Agent's Patch Before You Trust Its Tests

Comments
5 min read
Mutation Testing as a Merge Gate for Agent-Written Tests

Mutation Testing as a Merge Gate for Agent-Written Tests

Comments
5 min read
The Agent's Tests Passed. Mutation Testing Showed 2 of 4 Faults Survived.

The Agent's Tests Passed. Mutation Testing Showed 2 of 4 Faults Survived.

Comments
5 min read
A Free Model Rewrote My Parser. Differential Testing Decided Whether I Merged It.

A Free Model Rewrote My Parser. Differential Testing Decided Whether I Merged It.

Comments
5 min read
Three Gates for Agent Patches: Properties, Fixtures, and a Flaky Freeze

Three Gates for Agent Patches: Properties, Fixtures, and a Flaky Freeze

Comments
6 min read
Case Study: The Thread Pool Passed 64/64 Tasks. ThreadSanitizer Found the Race in the Destructor

Case Study: The Thread Pool Passed 64/64 Tasks. ThreadSanitizer Found the Race in the Destructor

1
Comments
5 min read
The Free Model Wrote Tests That Passed. They Still Missed a Bug.

The Free Model Wrote Tests That Passed. They Still Missed a Bug.

Comments
4 min read
Case Study: A Free Model Wrote an SPSC Queue. Unit Tests Passed; the Server's TSan Run Didn't.

Case Study: A Free Model Wrote an SPSC Queue. Unit Tests Passed; the Server's TSan Run Didn't.

Comments
5 min read
87 Smart-Pointer Proposals From a Free Model. 31 Made It.

87 Smart-Pointer Proposals From a Free Model. 31 Made It.

Comments
3 min read
Case Study: A Free Model Triage of 1,400 C++ Warnings — the First 12 Were Wrong

Case Study: A Free Model Triage of 1,400 C++ Warnings — the First 12 Were Wrong

Comments
5 min read
Case Study: I Pinned 18 Prompts to a Free Model Endpoint. Two Broke Without a Code Change.

Case Study: I Pinned 18 Prompts to a Free Model Endpoint. Two Broke Without a Code Change.

Comments
4 min read
Case Study: The C++20 Migration Compiled Clean. A 40-Line Property Test Found the Ordering Break.

Case Study: The C++20 Migration Compiled Clean. A 40-Line Property Test Found the Ordering Break.

Comments
5 min read
Case Study: A Free Model Wrote a C++ TODO Expiry Checker. Compilation Passed; the Fixture Didn't.

Case Study: A Free Model Wrote a C++ TODO Expiry Checker. Compilation Passed; the Fixture Didn't.

Comments
5 min read
Case Study: A Free Model Wrote the Fuzz Target. A Free Server Found the Off-by-One.

Case Study: A Free Model Wrote the Fuzz Target. A Free Server Found the Off-by-One.

Comments
5 min read
Case Study: A C++ Cache Proxy That Cut Free-Tier Model Calls by 73%

Case Study: A C++ Cache Proxy That Cut Free-Tier Model Calls by 73%

Comments
4 min read
Case Study: A Free Model's C++ Token Bucket Passed 18 Tests. NTP Broke It in One Second.

Case Study: A Free Model's C++ Token Bucket Passed 18 Tests. NTP Broke It in One Second.

Comments
5 min read
Case Study: A C++ Build-Failure Triage Bot — Cache First, Recompile as the Gate

Case Study: A C++ Build-Failure Triage Bot — Cache First, Recompile as the Gate

Comments
5 min read
Case Study: A .gitignore Validator in C++ — 47 Vectors, 3 Rounds, 2 Gaps

Case Study: A .gitignore Validator in C++ — 47 Vectors, 3 Rounds, 2 Gaps

Comments
5 min read
Case Study: A Free Model's C++ Hash Map Passed 42 Tests. The Scaling Curve Found the O(n ).

Case Study: A Free Model's C++ Hash Map Passed 42 Tests. The Scaling Curve Found the O(n ).

Comments
4 min read
loading...