Doordash
Read post

Lessons learned building DoorDash’s clusterless ML feature store

DoorDash shares how they built a clusterless, stateless ML feature store to replace a costly Redis-plus-relational-database hybrid that couldn't scale further. The new system uses Apache Kvrocks (a Redis-protocol-compatible store backed by RocksDB) running on commodity SSD instance-store disks, with a custom Redis Cluster Manager (RCM) that provides topology transparency to clients without requiring actual cluster state sharing. Data is batch-loaded from S3 as RocksDB backups, enabling stateless horizontal scaling. A two-phase rollout (shadow validation then traffic migration) validated the design. A key discovery was that large Redis clusters degrade client performance at 2,000+ nodes, solved by having RCM return a per-client subset of nodes. The system now handles 130M HMGETs per second serving 1.6B features within a 50ms P999 latency target.

    #distributed-systems#redis
May 18•10m read time•From careersatdoordash.com
Post cover image
Table of contents
DoorDash ML platform overviewML feature store evolutionML feature store: A new platformArchitecture overviewStay Informed with Weekly UpdatesPlease enter a valid email address.Thank you for Subscribing!It’s not real until it’s realFinal thoughts
1.4K Impressions
Doordash's image
Doordash

DoorDash offers insights into food delivery technology, logistics, and customer experience. Develope...

22 Followers

•

42 Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard