Lyft Engineering
Read post

Beyond A/B Testing: Using Surrogacy and Region-Splits to Measure Long-Term Effects in Marketplaces

Lyft's Foundational Models team describes a methodology for estimating long-term, market-mediated effects of pricing and incentive decisions in a two-sided marketplace. Standard A/B tests can't capture these effects because policy changes ripple through supply and demand in complex ways. The framework uses a two-step surrogacy approach: first, residualized regression models map policy changes to shifts in negative user experiences (wait times, surge, driver idleness); second, doubly-robust AIPW causal estimation maps those experience shifts to future behavioral outcomes via a surrogacy index. Both steps are validated with switch-back and user-split experiments respectively. Finally, direct and market-mediated long-term effects are combined and verified end-to-end using region-split experiments, with a forward-selection algorithm to optimize treated/control region matching. The result is a continuously calibrated causal engine for budget allocation and scenario planning.

    #data-science#ab-testing
Mar 25•9m read time•From eng.lyft.com
Post cover image
Table of contents
BackgroundSummary of our solutionStep 1: from decisions to negative user experiencesGet Iraklikhorguani ’s stories in your inboxStep 2: from negative user experiences to future outcomesStep 3: verify overall LTE by region-split experimentsConclusion
789 Impressions
Lyft Engineering's image
Lyft Engineering

LyftEng's platform is a central hub for engineering insights and technology updates from Lyft's engi...

10 Followers

•

14 Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard