The Accuracy Trap: 3 Faults in 100 Runs, Confusion Counts & the «Always OK» Model
All lessons
- The Accuracy Trap: 3 Faults in 100 Runs, Confusion Counts & the «Always OK» ModelFree
- Metrics That Respect the Minority: Balanced Accuracy, the Matthews Coefficient, F1 & Fβ Locked
- Random Undersampling & Oversampling: Given Draw Tables, New Class Shares & What Gets Lost Locked
- Synthetic Minority Samples: Neighbour Distances, the k Nearest & New Points by Interpolation Locked
- Class Weights: n ÷ (k × n_class), a Weighted Log-Loss & a New Best Cut-Off Locked
- Cost-Based Thresholds: A Cost Matrix, Expected Cost per Run & the Cheapest Cut-Off Locked
- Probability Correction After Resampling: Training vs Real Prevalence & a Calibration Table Locked
- Capstone – Comparing Strategies: Balanced Accuracy, MCC, Recall, Expected Cost & a Ranked Summary Locked
You are not signed in — the lab works, but your progress is not saved. Sign up
Loading the spreadsheet…