Symbol Frequencies: Counting Symbols, Probabilities & Surprise
This lesson is part of the course
In this lesson
You count how often each level code occurs in 32 sensor readings, turn the counts into probabilities, measure the surprise of each symbol in bits and chart the frequencies.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Bits & Bytes of Text: Characters, Raw Size & a Fixed-Length Code Locked
- Run-Length Encoding: Runs in a Scan Line, Encoded Size & When RLE Backfires Locked
- Symbol Frequencies: Counting Symbols, Probabilities & Surprise Locked
- Entropy: −Σ p · log₂ p and the Minimum Bits per Symbol Locked
- Huffman Codes: Merging the Two Smallest Weights, Code Lengths & Average Bits Locked
- Ratios, Savings & Overhead: Compression Ratio, Base-64 Size and Headers Locked
- Lossy Compression: Quantising to Steps, Error & Signal-to-Noise Ratio Locked
- Capstone: Storage and Transfer Savings from Compression Ratios Locked