Recent Papers / arXiv:2606.06560

MacArena: Benchmarking Computer Use Agents on an Online macOS Environment

arXiv:2606.06560Submitted Jun 8, 20260 benchmark results

Authors pending

View PDF ↗arXiv page ↗Edit
Abstract

421 manually verified tasks (50 apps) on native Apple Silicon; model rankings invert between ported and macOS-native tasks (leader trails by >26%), revealing cross-platform GUI competence gaps.

Tasks
edit
• Benchmarks
Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit
  • MacArena: per-model accuracy on macOS-native subset (abstract reports leader trailing >26%)
Add or update benchmark results
Logged-in editor · benchmark trail
Read next

Three places to go from here.

Index
All papers
All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.
Replacement
Papers with Code is dead — alternatives
What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.
Top hub
Benchmarks
Every benchmark in Benchmarks.