Monzo rebuilt its data platform around a 'meshy' approach to support 100+ teams managing 12,000+ dbt models. The architecture enforces four modeling layers (landing, normalized, logical, presentation), explicit cross-team interface models, and CI-backed validation of structure, naming, and access patterns. A custom CLI tool called Modelgen generates SQL and YAML models from object definitions. Early results from a 30%-complete migration show roughly 40% warehouse cost reduction and 25% faster data landing times. The approach treats data interfaces as first-class code, with automated guardrails replacing manual review to maintain quality at scale.

4m read timeFrom infoq.com
Post cover image
157 Impressions