Codesota · Models · Mixtral-8x7bMistral16 results · 2 benchmarks
Model card

Mixtral-8x7b.

Mistralopen-source
§ 01 · Benchmarks

Every benchmark Mixtral-8x7b has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting9.3%#5/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay8.9%#13/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities9.4%#20/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning5.8%#22/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score7.6%#22/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath5.7%#23/50—source ↗
07Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding5.2%#23/50—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction8.2%#26/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem8.6%#26/50—source ↗
10PLCCNatural Language Processing · Polish Cultural Competencyhistory56.0%#127/165—source ↗
11PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment31.0%#133/165—source ↗
12PLCCNatural Language Processing · Polish Cultural Competencygeography44.0%#141/165—source ↗
13PLCCNatural Language Processing · Polish Cultural Competencyaverage35.3%#145/165—source ↗
14PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition27.0%#147/165—source ↗
15PLCCNatural Language Processing · Polish Cultural Competencygrammar34.0%#151/165—source ↗
16PLCCNatural Language Processing · Polish Cultural Competencyvocabulary20.0%#161/165—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Mixtral-8x7b actually performs.

Natural Language Processing
2
benchmarks
avg rank #74.1
§ 04 · Related models

Other Mistral models scored on Codesota.

Mistral OCR 3
6 results
Codestral 22B
Unknown params · 2 results
Devstral 2
1 result
Devstral Small 2505
1 result
Mistral Large 3
123B params · 1 result
Mistral OCR 2
1 result
Mixtral-8x22b
1 result
Devstral Small
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
sdadas/PLCC
7
results
16 of 16 rows marked verified.