A data professional at ManyChat shares a detailed retrospective on selecting an A/B testing and experimentation platform, ultimately choosing Eppo over Statsig. The process involved stakeholder interviews to convert anecdotal pain into concrete requirements, a phased evaluation (desk research → demos → POC with two finalists), and a weighted scorecard. The platforms scored nearly identically (4.36 vs 4.47), so the tiebreaker came down to trajectory: Eppo's opinionated, PM-friendly workflows aligned better with the goal of democratizing experimentation beyond analysts. Post-signing, the author discovered the real work was just beginning — governance, process design, training curricula, and change management all had to precede any velocity gains. Key lessons: a credible decision process matters more than the platform chosen, and signing a contract is the start of organizational change, not the finish line.

14m read timeFrom towardsdatascience.com
Post cover image
Table of contents
BeforeDuringAfterClosing notes
8.2K Impressions