Stop 09 · Growth & ExperimentationTopics · 2/10

A/B Testing Fundamentals

Part of the Product Management Roadmap

In short

Randomly splitting users into a control and variant group to measure a change's real causal impact — the gold standard for validating that a feature actually improved the metric you care about.

How to learn this

  1. 1Design an A/B test for a real feature idea, including control and variant.
  2. 2Learn the difference between correlation and causation, and why A/B tests solve for the latter.
  3. 3Understand common pitfalls: novelty effects, seasonality, and running tests too briefly.

More topics at this stop

Stuck on this topic? Ask an Insider

Get 1:1 guidance from people who've walked this exact path — on the InsideEdge app.

Download
InsideEdge