Recent Papers / arXiv:2605.15846

RoadmapBench: Evaluating Long-Horizon Agentic Software Development Across Version Upgrades

arXiv:2605.15846Submitted May 20, 20260 benchmark results

Authors pending

View PDF ↗arXiv page ↗Edit
Abstract

115 long-horizon coding tasks from real version upgrades across 17 repos

Tasks
edit
• Code generation
Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit
  • Verify that RoadmapBench Claude-Opus-4.7 resolves only 39.1% of tasks.
Add or update benchmark results
Logged-in editor · benchmark trail
Read next

Three places to go from here.

Index
All papers
All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.
Replacement
Papers with Code is dead — alternatives
What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.
Top hub
Code generation
Every benchmark in Code generation.