Full Stack Experimentation
What are the chances a new feature release goes horribly wrong? Good product teams don’t even want to find out. The stakes are high, and catastrophic failures are possible, even for tested features. To mitigate these risks, many turn to feature flags and rollouts. These act as a safety...
Optimization
On the 19th of June, I had the opportunity to attend a conference I have only heard great things about, Growth Marketing Summit (or Growth Minded Superheroes!). Not only was this my first time at the conference but also my first time in Frankfurt. With the Euros in Germany,...
A/B Testing
A/B testing has rightfully earned its place as the gold standard for validating ideas and driving optimization. Nothing is more trustworthy (well, meta-analyses of trustworthy experiments are right up there) than adequately powered A/B tests, run from a balanced backlog, and rigorously checked for perverse incentives. But what happens...
A/B Testing
As an optimizer, you know that numbers don’t lie. But you also know that without the right context, even the most impressive metrics can lead you astray. Quantitative data, for all its precision and objectivity, only reveals the “what” of user behavior — the pages where visitors bounce, the...
Optimization
Most marketing and product teams are aware that conversion rate optimization is how brands level up from average results to extraordinary ones. What they may not realize is that without implementing experimentation rigor across all phases of your testing program, you may be leaving money on the table. Implementing...
A/B Testing
Have you heard the story of the sea captains who killed their passengers? In the 1700s, the British government paid captains to transport prisoners to Australia. To cut costs, the captains provided inadequate food and care, so only a few passengers arrived in Australia alive. The survival rate rose...