Codesota · Models · PLLuM-12B-nc-chatPLLuM16 results · 2 benchmarks
Model card

PLLuM-12B-nc-chat.

PLLuMopen-source
§ 01 · Benchmarks

Every benchmark PLLuM-12B-nc-chat has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities9.5%#15/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem9.1%#19/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score6.5%#27/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting7.5%#30/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding4.5%#32/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay6.8%#32/50—source ↗
07Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction7.2%#33/50—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning4.8%#33/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath2.3%#46/50—source ↗
10PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment59.0%#68/165—source ↗
11PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition65.0%#76/165—source ↗
12PLCCNatural Language Processing · Polish Cultural Competencyvocabulary52.0%#89/165—source ↗
13PLCCNatural Language Processing · Polish Cultural Competencyaverage59.5%#91/165—source ↗
14PLCCNatural Language Processing · Polish Cultural Competencygeography70.0%#91/165—source ↗
15PLCCNatural Language Processing · Polish Cultural Competencyhistory70.0%#94/165—source ↗
16PLCCNatural Language Processing · Polish Cultural Competencygrammar41.0%#144/165—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where PLLuM-12B-nc-chat actually performs.

Natural Language Processing
2
benchmarks
avg rank #57.5
§ 04 · Related models

Other PLLuM models scored on Codesota.

Llama-PLLuM-70B-chat
0 results
Llama-PLLuM-70B-chat-250801
0 results
Llama-PLLuM-8B-chat
0 results
PLLuM-12B-chat
0 results
PLLuM-12B-nc-chat-250715
0 results
PLLuM-8x7B-chat
0 results
PLLuM-8x7B-nc-chat
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
sdadas/PLCC
7
results
16 of 16 rows marked verified.