Tutorvo

A/B Test Readouts: Relative Lift, the z-Value, Ship or Not, and the Peeking Trap

Lesson 4 of 816 minLab

This lesson is part of the course

In this lesson

You read out a checkout test with its relative lift and a pooled z-value, then apply one decision rule to three more tests – including one that was peeked at too early and one that is a significant loss.

Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.

Lessons in this course

  1. Funnel Questions: Step Conversion, Where the Drop Is and What a 1-Point Lift Is WorthLab15 min Locked
  2. Campaign Economics: ROAS, ROI on Gross Profit, CAC, Payback and the Blended CAC TrapLab15 min Locked
  3. Attribution Cases: Last Click, First Click, Linear and Position-Based on the Same PathsLab16 min Locked
  4. A/B Test Readouts: Relative Lift, the z-Value, Ship or Not, and the Peeking TrapLab16 min Locked
  5. Cohort Questions: Retention by Signup Month, Revenue to Date per Signup and the Healthiest CohortLab15 min Locked
  6. Sizing and Budget Questions: a Top-Down Market Estimate, Clicks and Budget for a Target, and the 3:1 CheckLab14 min Locked
  7. The Exhibit Case: Clean a Messy Campaign Export, Build the Summary, Name the Insight and Chart ItLab16 min Locked
  8. Timed Mock Interview: Twelve Mixed Questions on One Data Set and a Self-ScoreLab18 min Locked