Codesota · Models · Step-3.5-FlashStepFun2 results · 2 benchmarks
Model card

Step-3.5-Flash.

StepFunopen-sourceUnknown params
§ 01 · Benchmarks

Every benchmark Step-3.5-Flash has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01SWE-BenchComputer Code · Code Generationresolve-rate74.4%#17/322026-01-01source ↗
02SWE-bench VerifiedAgentic AI · SWE-benchresolve-rate74.4%#24/81source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Step-3.5-Flash actually performs.

Computer Code
1
benchmark
avg rank #17.0
Agentic AI
1
benchmark
avg rank #24.0
§ 03 · Papers

1 paper with results for Step-3.5-Flash.

  1. 2023-10-10· Computer Code· 1 result

    SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

    Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao et al.
§ 05 · Sources & freshness

Where these numbers come from.

swebench-leaderboard
1
result
editorial
1
result
2 of 2 rows marked verified.