Act As a Real Researcher: A Suite of Benchmarks Evaluating Frontier LLMs and Agentic Harnesses in Research Lifecycle

arXiv:2606.07462Submitted Jun 8, 20260 benchmark results

Authors pending

Abstract

AARRI-Bench targets granular research behavior; best system (Mini-SWE-Agent + Claude Opus 4.7) achieves only 68.3%, frequently missing subtle details humans catch.

Tasks

edit

• Benchmarks

Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit

Link this paper to benchmark rows, datasets, model cards, and reproduced results as evidence is extracted.

Add or update benchmark results

Logged-in editor · benchmark trail

Three places to go from here.

Index

All papers

All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.

Replacement

Papers with Code is dead — alternatives

What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.

Top hub

Benchmarks

Every benchmark in Benchmarks.