Model card
gemma-3-12b-it.
Googleopen-source
§ 01 · Benchmarks
Every benchmark gemma-3-12b-it has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | stem | 10.0% | #1 | — | source ↗ |
| 02 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | humanities | 10.0% | #1 | — | source ↗ |
| 03 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | coding | 8.3% | #2 | — | source ↗ |
| 04 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | roleplay | 9.4% | #3 | — | source ↗ |
| 05 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | pl-score | 9.0% | #4 | — | source ↗ |
| 06 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | writing | 9.3% | #7 | — | source ↗ |
| 07 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | math | 7.5% | #10 | — | source ↗ |
| 08 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | extraction | 9.6% | #10 | — | source ↗ |
| 09 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | reasoning | 7.8% | #11 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where gemma-3-12b-it actually performs.
§ 04 · Related models
Other Google models scored on Codesota.
Gemini 2.5 Pro
16 results · 3 SOTA
Gemini 3 Pro
Undisclosed params · 13 results · 2 SOTA
Gemini 1.5 Pro
12 results · 1 SOTA
Gemini 3.1 Pro
3 results · 1 SOTA
ViT-H/14
632M params · 2 results · 1 SOTA
CoCa (finetuned)
2.1B params · 1 result · 1 SOTA
Gemini 2.0 Flash
1 result · 1 SOTA
Gemini 3.1 Pro Preview
1 result · 1 SOTA
§ 05 · Sources & freshness
Where these numbers come from.
SpeakLeash/MT-Bench-PL
9
results
9 of 9 rows marked verified.