Model card
EuroLLM-1.7B-Instruct.
utter-projectopen-source1.66B params
§ 01 · Benchmarks
Every benchmark EuroLLM-1.7B-Instruct has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | tricky-questions | 0.8% | #85 | — | source ↗ |
| 02 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | phraseology | 2.3% | #86 | — | source ↗ |
| 03 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | average | 1.8% | #88 | — | source ↗ |
| 04 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | language-understanding | 1.8% | #88 | — | source ↗ |
| 05 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | sentiment | 2.2% | #91 | — | source ↗ |
| 06 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | eq-bench | 9.8% | #253 | — | source ↗ |
| 07 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polqa-open-book | 73.2% | #388 | — | source ↗ |
| 08 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | dyk | 27.0% | #436 | — | source ↗ |
| 09 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | cbd | 15.5% | #442 | — | source ↗ |
| 10 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | average | 9.2% | #464 | — | source ↗ |
| 11 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | ppc | 34.3% | #477 | — | source ↗ |
| 12 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polemo2-in | 28.5% | #484 | — | source ↗ |
| 13 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | belebele | 24.0% | #485 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where EuroLLM-1.7B-Instruct actually performs.
§ 04 · Related models
Other utter-project models scored on Codesota.
§ 05 · Sources & freshness
Where these numbers come from.
speakleash/open_pl_llm_leaderboard
8
results
SpeakLeash/CPTU-Bench
5
results
13 of 13 rows marked verified.