Codesota · Models · PLLuM-8x7B-nc-chatPLLuM16 results · 2 benchmarks
Model card

PLLuM-8x7B-nc-chat.

PLLuMopen-source
§ 01 · Benchmarks

Every benchmark PLLuM-8x7B-nc-chat has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem8.9%#21/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction8.4%#23/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score6.4%#28/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay6.9%#30/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning5.0%#30/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting7.4%#32/50—source ↗
07PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment72.0%#33/165—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath3.4%#38/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding4.1%#39/50—source ↗
10Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities7.5%#41/50—source ↗
11PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition76.0%#46/165—source ↗
12PLCCNatural Language Processing · Polish Cultural Competencyvocabulary68.0%#48/165—source ↗
13PLCCNatural Language Processing · Polish Cultural Competencyaverage68.2%#69/165—source ↗
14PLCCNatural Language Processing · Polish Cultural Competencyhistory73.0%#82/165—source ↗
15PLCCNatural Language Processing · Polish Cultural Competencygeography73.0%#83/165—source ↗
16PLCCNatural Language Processing · Polish Cultural Competencygrammar47.0%#123/165—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where PLLuM-8x7B-nc-chat actually performs.

Natural Language Processing
2
benchmarks
avg rank #47.9
§ 04 · Related models

Other PLLuM models scored on Codesota.

Llama-PLLuM-70B-chat
0 results
Llama-PLLuM-70B-chat-250801
0 results
Llama-PLLuM-8B-chat
0 results
PLLuM-12B-chat
0 results
PLLuM-12B-nc-chat
0 results
PLLuM-12B-nc-chat-250715
0 results
PLLuM-8x7B-chat
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
sdadas/PLCC
7
results
16 of 16 rows marked verified.