Recent Papers / arXiv:2606.05080

AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?

arXiv:2606.05080Submitted Jun 4, 20260 benchmark results

Authors pending

View PDF ↗arXiv page ↗Edit
Abstract

36 expert-curated tasks for ultra long-horizon closed-loop optimization; finds persistence—not initial quality—is the dominant success predictor.

Tasks
edit
• Benchmarks
Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit
  • AutoLab: task completion rate under wall-clock budget across 36 long-horizon optimization tasks
Add or update benchmark results
Logged-in editor · benchmark trail
Read next

Three places to go from here.

Index
All papers
All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.
Replacement
Papers with Code is dead — alternatives
What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.
Top hub
Benchmarks
Every benchmark in Benchmarks.