Test sample playbooks

[CXL]

3 Playbooks

Avoid sample pollution

Get statistically significant and relevant data for your A/B test analyses.

Estimate required sample size for an experiment for difference in means

Design A/B tests based on continuous metrics which are usually more informative than conversion rate tests.

Estimate required sample size for an experiment for difference in conversion rates

Design A/B tests based on binomial metrics like conversion rate per user, subscribe rate per user, and others.

Last edited by @hesh_fekry 2023-11-14T10:44:24Z