Tutorvo

Average Precision & MAP: Rewarding Good Order

Lesson 4 of 815 minLab

This lesson is part of the course

In this lesson

You calculate the precision at every relevant rank for four queries, turn it into average precision (AP), average it to the MAP and see two queries with the same precision@10 but very different AP.

Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.

Lessons in this course

  1. Search Quality: Precision@k, Recall@k & Hit RateLab15 min Locked
  2. Mean Reciprocal Rank: How Soon Is the First Good Answer?Lab14 min Locked
  3. NDCG@k: Graded Relevance and the Ideal RankingLab17 min Locked
  4. Average Precision & MAP: Rewarding Good OrderLab15 min Locked
  5. Thresholds, the ROC Curve & AUC by TrapezoidsLab18 min Locked
  6. Calibration: Does 90% Confident Mean 90% Correct?Lab15 min Locked
  7. LLM-as-a-Judge: Percent Agreement & Cohen's KappaLab17 min Locked
  8. A/B Testing Two Models: Win Rate, Ties & a Confidence IntervalLab18 min Locked