Entropy: −Σ p · log₂ p and the Minimum Bits per Symbol
This lesson is part of the course
In this lesson
You calculate the entropy of the river sensor step by step, compare it with a 2-bit fixed code, and compute the entropy of two other sources in one SUMPRODUCT formula each.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Bits & Bytes of Text: Characters, Raw Size & a Fixed-Length Code Locked
- Run-Length Encoding: Runs in a Scan Line, Encoded Size & When RLE Backfires Locked
- Symbol Frequencies: Counting Symbols, Probabilities & Surprise Locked
- Entropy: −Σ p · log₂ p and the Minimum Bits per Symbol Locked
- Huffman Codes: Merging the Two Smallest Weights, Code Lengths & Average Bits Locked
- Ratios, Savings & Overhead: Compression Ratio, Base-64 Size and Headers Locked
- Lossy Compression: Quantising to Steps, Error & Signal-to-Noise Ratio Locked
- Capstone: Storage and Transfer Savings from Compression Ratios Locked