Fly.io
Read post

Corrosion

Corrosion is an open-source distributed service discovery system built with Rust, SQLite, and CRDTs that uses gossip protocols instead of distributed consensus. Developed by Fly.io to solve global state synchronization across their platform, it propagates SQLite databases using SWIM-based gossip and cr-sqlite for conflict resolution. The article details major outages caused by the system, including a deadlock bug that locked up their entire proxy fleet, and describes their iterative improvements: watchdogs for event-loop stalls, extensive testing with Antithesis, eliminating partial updates, and regionalizing clusters to reduce blast radius.

    #architecture#rust#distributed-systems#sqlite
Oct 22, 2025•11m read time•From fly.io
Post cover image
Table of contents
Our Face-Seeking RakeCorrosionShit HappensIterationThe New System Works
157.8K Impressions2 Comments
Fly.io's image
Fly.io

Fly.io offers insights into edge computing, serverless architecture, and global content delivery net...

109 Followers

•

843 Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard