Statistical Significance in A/B Tests

Summary

Applying Phase 4's hypothesis testing directly to a live experiment — checking whether an observed difference between variants is likely real, not noise, before rolling out a change.

• 1Calculate significance for a simple two-variant test using real or sample numbers.
• 2Learn why 'peeking' at results early and stopping on a good day inflates false positives.
• 3Practice explaining a non-significant result honestly, without over-interpreting it.