5 Ways Digital Marketers Use Call Tracking to Grow Their Business
Blog /A/B Testing

[VIDEO] 95% Test Confidence and How to Learn from Tests that Don’t Reach It

28th Mar 2019 –

We all want to hit the mythical 95% statistical significance number.

It’s a guideline that has morphed into a hard, non-negotiable requirement for most testers.

While opinions abound and the debate is still raging, we are not concerned with busting the myth (or not) of 95% statistical significance.

What we are more concerned about is maximizing your learning from each and every experiment.

In this video, Justin Christianson, the author of the CRO best-seller Conversion Fanatic walks you through:

  • Concrete steps to take and tweaks to make if your tests are simply refusing to reach the 95% statistical confidence mark.
  • A couple of things you can look at to derive key insights from tests that haven’t hit the desired confidence level.

Each test is an investment of resources. Make the most of the numbers it pulls in.

Originally published March 28, 2019 - Updated December 07, 2020

Start 15-Day Free Trial Of Convert Experiences.

Quick form submission
Quick submission.
No credit card needed
No credit card needed.
You can always change your preferences later.
Check Icon
You're Almost Done.
Managing Marketing Team
Managing Tech Team
Hypothesizing Experiments
Coding and QA of Experiments
Convert is committed to protecting your privacy.

You've successfully submitted your details to start your Convert Experiences 15-day free trial.

We are setting up your account for you. You'll receive a welcome message to your registered email with your login access. Please explore the app on desktop for an optimal experience.