Type I and Type II Errors in A/B Testing: How False Positives and False Negatives Undermine Your Results
Type I and type II errors happen when you erroneously spot winners in your experiments or fail to spot them. With both errors, you end up going with what appears to work or not. And not with the real results. Misinterpreting test results doesn't just result in misguided optimization efforts...