TensorBench: Benchmarking Coding Agents on a Compiler-Based Tensor Framework

arXiv:2606.05570Submitted Jun 5, 20260 benchmark results

Authors pending

Abstract

199 repo-level tasks on a real PyTorch extension; strongest agent passes 64.8%, and pairwise agreement between agents is low (κ=0.05), revealing task-specific skill gaps.

Tasks

edit

• Code generation

Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit

TensorBench pass rates and pairwise Cohen's κ across 7 agents

Add or update benchmark results

Logged-in editor · benchmark trail

Three places to go from here.

Index

All papers

All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.

Replacement

Papers with Code is dead — alternatives

What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.

Top hub

Code generation

Every benchmark in Code generation.