Metrics, Hypothesis & Minimum Detectable Effect
This lesson is part of the course
In this lesson
You write Harbor & Pine's first test plan: baselines for the primary, secondary and guardrail metric, the target conversion rate from the MDE and the guardrail limit.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Metrics, Hypothesis & Minimum Detectable Effect Locked
- Sample Size for a Conversion Test (80% Power) Locked
- Test Duration: From Sample Size to Full Weeks Locked
- Analysing a Conversion Test: z-Test, p-Value & Confidence Interval Locked
- Revenue per Visitor: Welch t-Test on Skewed Data Locked
- Many Variants: The Multiple-Comparison Problem & Bonferroni Locked
- Sample Ratio Mismatch: Chi-Square Check of the Traffic Split Locked
- Peeking & Sequential Testing: Why Early Stops Lie Locked