Statistical Significance in Experiments

Summary

Applying the stats basics from Phase 4 specifically to A/B tests — knowing your required sample size and test duration before you launch, not deciding to stop once you like the number.

• 1Use a free online sample size calculator for a hypothetical A/B test.
• 2Learn why stopping a test as soon as it looks significant inflates false positives.
• 3Practice explaining a non-significant result without over-interpreting it as 'no effect'.