Quick search for:
How do you ensure your experiments are not impacted by other improvements done by other teams?
1 Answer
Adobe Director of Product Management, Growth • February 19
Governance / air-traffic control of AB tests is essential. Running parallel AB tests on the same KPI and same audience will not guarantee clean results. If improvements done by teams are direct to production, timed before an AB test, it may not be an issue as both control and variant receive the changes thereby retaining the validity of the results. Most testing platforms come with some inbuilt conflict resolution, but I highly recommend bringing teams together in targeted forums to not only ensure there is no test pollution but also, and most importantly, align learnings.
606 Views
Related Questions
What happens when an experiment fails? How do you pivot? What roles do you hire for when building a growth team?What resources would you recommend reading to learn more about product-led growth?How do you see growth product manager versus a business development or pure sales roles ? Differences and Similarities ?What metrics do growth product teams look at to define success? Which do you find to be the most important?How is the role of product growth manager different from other product managers?