Codesota · Models · Mistral-Nemo-Instruct-2407Mistral9 results · 1 benchmarks
Model card

Mistral-Nemo-Instruct-2407.

Mistralopen-source
§ 01 · Benchmarks

Every benchmark Mistral-Nemo-Instruct-2407 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities9.5%#15/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath6.7%#15/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding5.8%#17/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction8.9%#20/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning5.8%#22/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score7.4%#24/50—source ↗
07Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay7.5%#27/50—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem8.3%#29/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting6.4%#37/50—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Mistral-Nemo-Instruct-2407 actually performs.

Natural Language Processing
1
benchmark
avg rank #22.9
§ 04 · Related models

Other Mistral models scored on Codesota.

Mistral OCR 3
6 results
Codestral 22B
Unknown params · 2 results
Devstral 2
1 result
Devstral Small 2505
1 result
Mistral Large 3
123B params · 1 result
Mistral OCR 2
1 result
Mixtral-8x22b
1 result
Devstral Small
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
9 of 9 rows marked verified.