Model card
Mixtral-8x7B-Instruct-v0.1.
mistralaiopen-source46.7B params
§ 01 · Benchmarks
Every benchmark Mixtral-8x7B-Instruct-v0.1 has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Polish EQ-Bench | Natural Language Processing · Polish Emotional Intelligence | eq-score | 57.6% | #39 | — | source ↗ |
| 02 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | language-understanding | 3.2% | #65 | — | source ↗ |
| 03 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | phraseology | 2.9% | #65 | — | source ↗ |
| 04 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | tricky-questions | 1.8% | #70 | — | source ↗ |
| 05 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | average | 2.7% | #73 | — | source ↗ |
| 06 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | eq-bench | 48.5% | #76 | — | source ↗ |
| 07 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | sentiment | 3.1% | #79 | — | source ↗ |
| 08 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | belebele | 84.2% | #109 | — | source ↗ |
| 09 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | cbd | 30.9% | #129 | — | source ↗ |
| 10 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | average | 42.5% | #179 | — | source ↗ |
| 11 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | dyk | 51.7% | #182 | — | source ↗ |
| 12 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | ppc | 63.9% | #301 | — | source ↗ |
| 13 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polemo2-in | 53.7% | #437 | — | source ↗ |
| 14 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polqa-open-book | 51.7% | #471 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where Mixtral-8x7B-Instruct-v0.1 actually performs.
§ 04 · Related models
Other mistralai models scored on Codesota.
Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-Instruct-v0.3
7.25B params · 0 results
Mistral-7B-v0.3
0 results
Mistral-Large-Instruct-2407
123B params · 0 results
Mistral-Large-Instruct-2411
123B params · 0 results
Mistral-Nemo-Base-2407
0 results
§ 05 · Sources & freshness
Where these numbers come from.
speakleash/open_pl_llm_leaderboard
8
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
14 of 14 rows marked verified.