A/B Testing Significance
Eliminate guesswork from your experiments. Use our Bayesian-inspired statistical engine to validate your conversion improvements.
A/B Significance Engine
Determine winning variations with 95% confidence
Variation A
Variation B
Variation B outperformed Variation A by 42.9%.
Results are not significant yet.
There is currently a 2.1% probability that Variation B is better. We recommend continuing the test until reaching 95% confidence.
What is Confidence?
Statistical significance (Confidence) measures the likelihood that the difference between variations is not due to random chance. In A/B testing, a 95% confidence level is the industry standard for making business decisions.
When to stop testing?
You should stop a test only after achieving a significant result and reaching your pre-determined sample size. Stopping early (peeking) can lead to false positives. Ensure your variations have run for at least one full business cycle.