Tutorvo

Cost-Based Thresholds: A Cost Matrix, Expected Cost per Run & the Cheapest Cut-Off

Lesson 6 of 816 minLab

This lesson is part of the course

In this lesson

You price every cell of the confusion matrix, compute the expected cost per run for ten thresholds, pick the cheapest one with MIN and INDEX/MATCH and compare it with the break-even formula.

Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.

Lessons in this course

  1. The Accuracy Trap: 3 Faults in 100 Runs, Confusion Counts & the «Always OK» ModelLab15 minFree
  2. Metrics That Respect the Minority: Balanced Accuracy, the Matthews Coefficient, F1 & FβLab16 min Locked
  3. Random Undersampling & Oversampling: Given Draw Tables, New Class Shares & What Gets LostLab16 min Locked
  4. Synthetic Minority Samples: Neighbour Distances, the k Nearest & New Points by InterpolationLab17 min Locked
  5. Class Weights: n ÷ (k × n_class), a Weighted Log-Loss & a New Best Cut-OffLab16 min Locked
  6. Cost-Based Thresholds: A Cost Matrix, Expected Cost per Run & the Cheapest Cut-OffLab16 min Locked
  7. Probability Correction After Resampling: Training vs Real Prevalence & a Calibration TableLab16 min Locked
  8. Capstone – Comparing Strategies: Balanced Accuracy, MCC, Recall, Expected Cost & a Ranked SummaryLab18 min Locked