A/B Testing
Sharp, conclusive results you can trust, or diluted results that take too long to reach statistical significance? That’s the two-sided coin of thinking consciously about targeting and triggering in A/B testing vs not doing that. Targeting defines who is included in the experiment, and triggering decides when the variation...
Full Stack Experimentation
Ever had a hidden bug ruin your entire experiment? Imagine a backend disconnect causing data to go out of sync or a front-end flicker revealing the control version before the page loads. These seemingly minor issues can completely perforate the integrity of your test results and wipe out weeks...
Shopify Conversion Optimization, Shopify Conversion Optimization Strategies, Trending
As the year ends, holiday shopping is going to take eCommerce by storm. This is when many brands will record peak sales this year but some, sadly, won’t. And the defining difference here is preparation. Black Friday, Cyber Monday, Thanksgiving, Christmas, and New Year sales are notorious for pulling...
Shopify A/B Testing
Shopify’s infrastructure updates, particularly to its checkout systems, have prompted these improvements. In early 2023, Shopify announced it was deprecating checkout.liquid in favor of Checkout Extensibility, a sandboxed, controlled approach that protects sensitive data, is faster, and ensures checkout customizations don’t break during platform upgrades. While these changes mean...
Full Stack Experimentation
The future of experimentation is product. Experimenters have long focused on optimizing conversion rates for marketing. But the game is changing, and they’re breaking new ground. Ruben de Boer, Lead Conversion Manager at Online Dialogue, and John Ostrowski, Director of Product and Experimentation at Wise Publishing, are witnessing this...
Full Stack Experimentation
What are the chances a new feature release goes horribly wrong? Good product teams don’t even want to find out. The stakes are high, and catastrophic failures are possible, even for tested features. To mitigate these risks, many turn to feature flags and rollouts. These act as a safety...