[VIDEO] 95% Test Confidence and How to Learn from Tests that Don’t Reach It

Justin Christianson
March 28, 2019 ·

We all want to hit the mythical 95% statistical significance number.

It’s a guideline that has morphed into a hard, non-negotiable requirement for most testers.

While opinions abound and the debate is still raging, we are not concerned with busting the myth (or not) of 95% statistical significance.

What we are more concerned about is maximizing your learning from each and every experiment.

In this video, Justin Christianson, the author of the CRO best-seller Conversion Fanatic walks you through:

  • Concrete steps to take and tweaks to make if your tests are simply refusing to reach the 95% statistical confidence mark.
  • A couple of things you can look at to derive key insights from tests that haven’t hit the desired confidence level.

Each test is an investment of resources. Make the most of the numbers it pulls in.

99 Conversion Tips
99 Conversion Tips
Originally published March 28, 2019 - Updated December 10, 2021
Mobile reading? Scan this QR code and take this blog with you, wherever you go.
Justin Christianson
Justin Christianson Justin Christianson is the Founder of Conversion Fanatics

Start Your 15-Day Free Trial Right Now.
No Credit Card Required

You can always change your preferences later.
You're Almost Done.
I manage a marketing team
I manage a tech team
I research and/or hypothesize experiments
I code & QA experiments
Convert is committed to protecting your privacy.

Important. Please Read.

  • Check your inbox for the password to Convert’s trial account.
  • Log in using the link provided in that email.

This sign up flow is built for maximum security. You’re worth it!