This tool helps you compare the performance of two variants - commonly known as the control (A) and the variant (B) to determine which one performs better. By leveraging Bayesian statistics, our calculator estimates a probability that one variant performs better than a control, along with conversion rates and the percentage uplift between the two.
We believe strongly in the value of a Test & Learn approach as part of a broader data driven marketing strategy. If you would like to learn more about our more advanced and faster approaches to AB testing why not speak to us.
To get started, simply run your experiment by splitting your audience into two groups—one exposed to the control (A) and the other to the variant (B). Input the total number of events and conversions for both groups into our calculator. For reliable results, aim for a probability threshold of at least 95%, indicating a high confidence level that the variant truly performs better than the control. This threshold helps minimize the risk of false positives and ensures that your decisions are backed by robust data.
Total number of users (or events) exposed to Control (A).
Total number of users (or events) exposed to Variation (B).
Number of successful actions (e.g., signups) from Control (A).
Number of successful actions (e.g., signups) from Variation (B).