Let's summarize
  • A/B testing is a good insurance tactic against critical defects in the product.
  • Before you run the experiment, you need to decide on which metrics to use.
  • There's no guarantee that you will get a viable result in the process of hypothesis testing.
  • Make it a rule to run hypotheses through A/B, but also understand that it's better to run them wisely.
Additional useful materials