Thresholds, the ROC Curve & AUC by Trapezoids
This lesson is part of the course
In this lesson
You sweep the decision threshold of Fern's escalation classifier from 1.0 to 0.0, count true and false positives with COUNTIFS, turn them into TPR and FPR, draw the ROC curve and calculate the AUC with the trapezoid rule.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Search Quality: Precision@k, Recall@k & Hit Rate Locked
- Mean Reciprocal Rank: How Soon Is the First Good Answer? Locked
- NDCG@k: Graded Relevance and the Ideal Ranking Locked
- Average Precision & MAP: Rewarding Good Order Locked
- Thresholds, the ROC Curve & AUC by Trapezoids Locked
- Calibration: Does 90% Confident Mean 90% Correct? Locked
- LLM-as-a-Judge: Percent Agreement & Cohen's Kappa Locked
- A/B Testing Two Models: Win Rate, Ties & a Confidence Interval Locked