Codesota · Models · PLLuM-8x7B-chatPLLuM16 results · 2 benchmarks
Model card

PLLuM-8x7B-chat.

PLLuMopen-source
§ 01 · Benchmarks

Every benchmark PLLuM-8x7B-chat has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction8.0%#29/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem8.2%#30/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score6.3%#30/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding4.5%#32/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning4.9%#32/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities8.6%#33/50—source ↗
07Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting7.1%#35/50—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath3.5%#36/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay6.3%#36/50—source ↗
10PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition60.0%#89/165—source ↗
11PLCCNatural Language Processing · Polish Cultural Competencyhistory68.0%#100/165—source ↗
12PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment45.0%#100/165—source ↗
13PLCCNatural Language Processing · Polish Cultural Competencygeography66.0%#102/165—source ↗
14PLCCNatural Language Processing · Polish Cultural Competencyaverage54.2%#108/165—source ↗
15PLCCNatural Language Processing · Polish Cultural Competencyvocabulary44.0%#109/165—source ↗
16PLCCNatural Language Processing · Polish Cultural Competencygrammar42.0%#143/165—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where PLLuM-8x7B-chat actually performs.

Natural Language Processing
2
benchmarks
avg rank #65.3
§ 04 · Related models

Other PLLuM models scored on Codesota.

Llama-PLLuM-70B-chat
0 results
Llama-PLLuM-70B-chat-250801
0 results
Llama-PLLuM-8B-chat
0 results
PLLuM-12B-chat
0 results
PLLuM-12B-nc-chat
0 results
PLLuM-12B-nc-chat-250715
0 results
PLLuM-8x7B-nc-chat
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
sdadas/PLCC
7
results
16 of 16 rows marked verified.