Design & Document an A/B Test

Summary

The practice project for this phase — take a real hypothesis through the full lifecycle: design, sample size, success metric, guardrails, and a plan for how you'd interpret each possible result.

• 1Pick a real feature idea and write a testable hypothesis for it.
• 2Define your primary metric, guardrail metrics, and required sample size.
• 3Write out how you'd interpret a win, a loss, and an inconclusive result before running it.