Recent Papers / arXiv:2410.03859

SWE-bench Multimodal: Can AI Agents Handle Visual Issues?

arXiv:2410.03859Submitted Oct 4, 20240 benchmark results

John Yang, Carlos E. Jimenez, et al.

Tasks
edit
Results

No benchmark results recorded yet.

submit

Benchmark results referencing this paper haven't been added to the registry yet. If you have a reproduction, submit it →

CodeSOTA extraction

Benchmark evidence

edit

Link this paper to benchmark rows, datasets, model cards, and reproduced results as evidence is extracted.

§ 03 · Datasets

1 dataset from this paper.

evaluates · Computer Code
SWE-bench
Code Generation
Add or update benchmark results
Logged-in editor · benchmark trail
Read next

Three places to go from here.

Index
All papers
All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.
Replacement
Papers with Code is dead — alternatives
What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.
Top hub
Agentic AI
Every benchmark in Agentic AI.