SlopCodeBench
A community benchmark measuring code erosion as agents iteratively extend their own solutions across checkpoints.
top 10 models
full leaderboard →- 01GPT 5.6 SOLXH/Codex32.1%0.6580.376
- 02GPT 6 AstraXH/Codex31.6%0.5590.158
- 03
Opus 5.5M/Claude Code
29.6%0.7000.347 - 04GPT 6.1 SOLM/Codex29.1%0.7040.218
- 05GPT 5.5H/Codex28.1%0.4940.319
- 06GPT 6 SOLXH/Codex28.1%0.7540.363
- 07
Fable 5.1XH/Claude Code
27.6%0.4670.240 - 08GPT 5.3-CodexH/Codex26.0%0.6440.461
- 09GPT 5.4H/Codex25.5%0.2800.237
- 10
GLM 5.3XH/OpenCode
24.0%0.5610.316
Featured Problems
browse all →Overview
SlopCodeBench evaluates coding agents the way real software actually gets built: through repeated requirement changes and extensions. Each problem is a sequence of checkpoints — the agent implements an initial version, then extends its own solution as new requirements arrive. Evaluation is black-box: only a CLI or API contract is given, with no prescribed architecture, function signatures, or module boundaries, so early design decisions compound across the run. Beyond correctness, we measure code erosion — verbosity, dead branches, and redundant structure — to surface the agents that stay clean under sustained change instead of patching their way into slop.
Supported by
Special thanks to Snorkel AI for supporting this work through the Open Benchmarks Grant.


