Do you remember when Uber was cheap? That’s not me doing a hackneyed stand-up routine from the 1970s where we hark back to the distant past and say how things used to be better. I’m talking about 2012. I am old enough to remember how you could get across London for £5 in a cab…
Read the full article→
We solemnly promise that each bit of content you read here
is thoughtfully curated or crafted by a human, for a human. We spend hundreds of hours every month speaking to experts with decades of experience. Our blogs are more a journalistic report on the state of experimentation than a single perspective article. Enjoy!
The title did not evolve. It split into four roles, and one of them is a CRO job. Back in 2022, I was horrified by some of the Head of Growth job specs I was seeing. They’d ask you to run the growth strategy, own experimentation, and, oh, five channels...
Christin Müller is the latest expert to open up their playbook for our Testing Mind Map series. These interviews look past the tidy version of experimentation and into the day-to-day: how evidence fares against conviction, which test wins survive contact with production, and where judgment sits now that AI has...
Can a smaller, cheaper, and more power-efficient (and more open) language model beat Anthropic's Fable model? You know, the language model that's so good it's a danger to humanity. According to benchmarks widely used by AI labs, the answer is: of course not. Are you crazy? But what if I...
Delphine Finders-Binje is the latest expert to open up their playbook for our Testing Mind Map series. These interviews look past the tidy version of experimentation and into the day-to-day: how evidence fares against conviction, which test wins survive contact with production, and where judgment sits now that AI has...
An autonomous experimentation loop automatically identifies active tests, reads their results, and acts within limits you set in advance. Maintain security by granting the loop least-privilege credentials, such as read-only access, to limit risk. Ensure statistical rigor using sequential testing and enforcing minimum runtimes to prevent acting on random noise....
Feature flags let you deploy code hidden behind a toggle, then turn it on for specific users without a redeploy. Rollouts use the same flag to expand access step by step. Developers use flags for internal testing, percentage-based rollouts, and A/B testing against a control group. Feature flag and rollout...
