Caíque Coelho
Sep 28, 2021

--

Awesome article, is so good to hear from people who really know so well what they are doing! Thanks for sharing this knowledge with us. I only have one question about when to decide to keep or not an experiment. If after a test A/B the treatment group doesn't show any meaningful evidence why did you guys decided to keep the new experience? Like was said, sometimes new features have bugs, and I think maybe is harder to keep and maintain new code. If we start thinking about possible bugs, regressive testing changes that should be made, documentation, scalability, and so on. Wouldn't it be better to keep the original experiment if the test doesn't materialize on any evidence?

--

--

Caíque Coelho

A QA lover and App Developer on weekends and a Data Scientist on free time. Founder App Teste Eneagrama.