Scaling to 1 million concurrent sandboxes in seconds
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
Modal rebuilt its sandbox platform from the ground up to support 1 million concurrent sandboxes, achievable in under a minute. The new architecture eliminates central coordination bottlenecks by replacing a centralized scheduler and durable datastore with a fleet of scheduling servers using in-memory cached worker state published via Redis streams. Workers become their own source of truth, sandbox creation requires only two network hops, and all O(sandboxes) and O(nodes) operations are horizontally scalable. Kubernetes-style strong consistency was traded for performance. Median sandbox start time is under 500ms. The system is in Beta and will soon back all Modal sandbox scheduling.
