Language Modeling is the task of predicting the next word or character in a sequence given the previous context. Language models learn the probability distribution of word sequences and are foundational for many NLP applications including text generation, machine translation, and speech recognition.
Language modeling quality measured by perplexity on Wikipedia text
Leading models on WikiText Perplexity.
No results yet. Be the first to contribute.
Questions, claims, and experiments linked through CodeSOTA’s public evidence graph.
Didn't find the model, metric, or dataset you needed? Tell us in one line. We read every message and reply within 48 hours.
55 datasets tracked for this task.
Still looking for something on Language Modeling? A missing model, a stale score, a benchmark we should cover — drop it here and we'll handle it.
Real humans read every message. We track what people are asking for and prioritize accordingly.