A/B Testing
When done right, a website survey can be one of the most powerful ways to understand the intent of users on a website. But why are they hardly ever used? And when they are, they are usually executed poorly. (Think NPS surveys where you care more about using the...
A/B Testing
A/B tests are the gold standard of evidence-based decision making for marketers, product managers, and all other business functions. Finding a platform that can help you run controlled experiments, however, isn’t so straightforward. While there are many tools available, it can be confusing to find the right platform for...
A/B Testing
We all want to make good data-driven decisions from our experiments. After all, that’s why we run experiments in the first place. But how many of us actually feel confident navigating the complexities of p-values and standard deviations to make truly well-informed and confident choices from our test results?...
A/B Testing
Sharp, conclusive results you can trust, or diluted results that take too long to reach statistical significance? That’s the two-sided coin of thinking consciously about targeting and triggering in A/B testing vs not doing that. Targeting defines who is included in the experiment, and triggering decides when the variation...
A/B Testing
If you’re planning to halt your A/B testing program for the holidays, you may be missing the most wonderful time of the year to capture customer insights. While it’s true – the holiday season is very different from rest-of-year, and shifts in traffic and customer behavior can pollute your...
A/B Testing
What Is MDE? Minimum detectable effect (MDE) is pretty simple on the surface, but it’s also one of the most confusing and misunderstood terms in online A/B testing. Well, it’s pretty close, but even those people know in the back of their minds that statistical power also factors into...