Martin Kleppmann, author of Designing Data-Intensive Applications and associate professor at Cambridge, discusses two major trends in data systems: the shift from monolithic databases to modular cloud-native building blocks, and the movement toward user data sovereignty. He explains the AT Protocol underlying BlueSky, which balances decentralization with a consistent user experience by using Personal Data Servers and a global firehose aggregator, allowing users to switch providers without losing data. He then dives into the local-first software movement, which advocates storing the primary data copy on the user's device to enable offline access, faster performance, and resilience against service shutdowns. Kleppmann highlights Automerge, an open-source Rust library with bindings for TypeScript, Swift, Java, Python, and Go, that enables real-time collaboration and Git-like version control for non-text formats like spreadsheets and CAD files. He also discusses limitations of local-first (not suitable for authoritative server data like bank balances), retrofitting existing apps, and the growing local-first conference community.

36m read timeFrom infoq.com
Post cover image
Table of contents
TranscriptThe Shift to Cloud-Native Architecture and Object Storage [ 01:46 ]Fragmenting Monolithic Data Systems into Modular Building Blocks [ 03:40 ]Decentralisation and Data Sovereignty: The Role of Protocols [ 07:16 ]The Local-First Movement: Empowering Users and Ensuring Data Agency [ 15:51 ]Bringing Git-Like Version Control to Non-Text Data and the Wider World [ 22:17 ]Automerge: The Open-Source Library for Local-First Collaboration [ 27:09 ]Limitations and When Local-First Does Not Apply [ 31:24 ]Joining the Movement: Building Apps and Contributing to Automerge [ 35:15 ]About the Author
51 Impressions