Tutorvo

Sample Ratio Mismatch: Chi-Square Check of the Traffic Split

Lesson 7 of 815 minLab

This lesson is part of the course

In this lesson

You check whether the 50/50 split of the new checkout test really came out 50/50, with a chi-square goodness-of-fit test and a strict SRM threshold.

Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.

Lessons in this course

  1. Metrics, Hypothesis & Minimum Detectable EffectLab14 min Locked
  2. Sample Size for a Conversion Test (80% Power)Lab16 min Locked
  3. Test Duration: From Sample Size to Full WeeksLab13 min Locked
  4. Analysing a Conversion Test: z-Test, p-Value & Confidence IntervalLab18 min Locked
  5. Revenue per Visitor: Welch t-Test on Skewed DataLab18 min Locked
  6. Many Variants: The Multiple-Comparison Problem & BonferroniLab18 min Locked
  7. Sample Ratio Mismatch: Chi-Square Check of the Traffic SplitLab15 min Locked
  8. Peeking & Sequential Testing: Why Early Stops LieLab18 min Locked