A/B Testing
Isn’t multivariate testing just several A/B tests running at the same time? No. That’s one of the most popular myths about MVT. It’s much more nuanced than that. Unlike A/B tests that compare one change at a time, multivariate tests evaluate multiple variables and their combinations simultaneously. It’s an...
A/B Testing
Some A/B tests are doomed before the first conversion rolls in. If your traffic split is off, even slightly, your results might look clean while quietly misleading you. That’s Sample Ratio Mismatch: when test variants don’t get the exposure they’re supposed to, and the assumptions behind your stats fall...
A/B Testing
There’s little worse than when your company loses trust in its data. To be clear, it’s rarely the data itself that’s the problem, but rather the people and processes around it, since raw data is rarely the “end product”. Accuracy doesn’t exist with marketing data, and it never will....
A/B Testing
Most people think of generative AI as a writing assistant for creating blog posts, ad copy, or brainstorming ideas. And while it’s helpful there, that’s not where it’s most powerful. The real magic shows up in analytics implementation. When setting up analytics (aka setting up tagging for a site),...
A/B Testing
Imagine we gave a classroom of students an essay topic and asked them to explore it however they chose. How diverse would we expect the finished essays to be? Pretty diverse, right? What if we instead gave the class a sample essay about the same topic and asked them...
A/B Testing
One of the ways businesses hurt themselves most in the analytics department is by only setting up one type of goal. And I know exactly what type they already set up without even looking at it. Bottom of funnel goals. When done right, top and middle funnel goals are...