Corpus & Tokens: Counting Words, Vocabulary Size & Unigram Probabilities
All lessons
- Corpus & Tokens: Counting Words, Vocabulary Size & Unigram ProbabilitiesFree
- Bigrams: Pairs of Neighbouring Words & the Next-Word Table Locked
- Probabilities: P(next | word) from Counts & the Probability of a Sentence Locked
- Smoothing: Add-One & Add-k So Unseen Words Still Get a Chance Locked
- Backoff & Interpolation: Mixing Bigram and Unigram, Choosing λ on Held-Out Text Locked
- Sentence Scores & Perplexity: Comparing Two Models on the Same Test Text Locked
- Autocomplete: Top-3 Suggestions, Breaking Ties & Falling Back for Unseen Contexts Locked
- Generation: Cumulative Probabilities, Random Numbers & a Sentence the Corpus Never Had Locked
You are not signed in — the lab works, but your progress is not saved. Sign up
Loading the spreadsheet…