Latency Budgets: Retry Delays, Runs Over the Limit & the 90th Percentile
This lesson is part of the course
In this lesson
You add the retry delays to 20 logged run times, measure the share of runs that miss a time limit and compare the 90th percentile with the average.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Compounding Reliability: Step Success Rates & End-to-End Success Locked
- Retries: Success After k Attempts, Expected Attempts & Extra Cost Locked
- Tokens & Tool Calls: What One Attempt Costs Locked
- Cost per Completed Task: Paying for Failed Runs & Comparing Three Designs Locked
- Human Hand-Offs: Confidence Thresholds, Review Minutes & Slip-Through Errors Locked
- Latency Budgets: Retry Delays, Runs Over the Limit & the 90th Percentile Locked
- The Evaluation Log: Reached, Passed & Step Success Rates from 30 Test Tasks Locked
- The Business Case: Human vs Agent Cost per Month, Payback & the Chart Locked