Our Statistical Significance Calculator features:
- Color coded bar to show Statistical Significance
- Split test calculator
- AB Test Calculator
- Direct comparison of conversion results.
- Ability to calculate significance of ab tests anywhere and with any tool
You may be asking yourself, what is ab testing? Or even, why do I need to calculate it?
Well, lets makes this easy for you. AB testing is one of the cornerstones to digital marketing, it is when you test two version of your site, email, ppc or other mediums against each other to see which one win. That said, when you run one of these comparative tests, you need to make sure you have a calculate statistical significance.
See this great video to better understand ab testing: https://www.youtube.com/watch?v=QSk4czi3TCs
How do we calculate statistical significance? We use a probability calculator based on statistics which will help us know if one test has enough volume and distribution to have a higher probability of being the correct outcome. If you do not measure the level of significance, you may launch a split test winner to production and find out that the results were not good.
Tools like Visual Website Optimizer, Optimizely and other ab testing tools have their own built in ab test calculators, but we do not trust/recommend these. You need to be measuring your AB tests in your analytics tools and calculating statistical significance of of that data. This will give you the best test of significance. Once we have run our statistical significance test we can verify if we have a real winner or not.
With our tool you can calculate statistical significance right in your Chrome browser. You can use this for email ab testing, website ab testing, mobile app ab testing, ppc ab testing and just about any testing period.
Calculating the significance of AB test results is always a hassle. Some analytics tools attempt to tell you when significance has been reached, and others simply pretend it doesn’t matter. Using the Effin Amazing Statistical Significance and AB Test Calculator you’ll be able to quickly determine whether your test results are significant - all from a simple chrome extension. Stop opening new tabs and searching for statistical significance calculators that are hard to use and harder to understand.
Have any questions or feedback? Let us know by emailing Dan@amazingcorps.com.