--- title: "How Uber Built an Exabyte-Scale System for Data Processing" url: https://daily.dev/posts/how-uber-built-an-exabyte-scale-system-for-data-processing-3wz2ejth7 source_url: https://blog.quastor.org/p/how-uber-built-an-exabyte-scale-system-for-data-processing-e6dc type: article source: "Quastor Daily" published: 2025-01-16T17:14:19.346Z updated: 2025-01-16T17:14:49.131Z tags: ["data-engineering", "apache-spark", "data-processing", "etl"] reading_time: 5 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # How Uber Built an Exabyte-Scale System for Data Processing **[Quastor Daily](https://daily.dev/sources/quastor)** · 5 min read · 0 upvotes · 0 comments ## Summary Uber handles its massive data needs with an Exabyte-scale ETL system, scaling their data processing with Apache Spark and a custom framework called Sparkle. The revamped architecture focuses on modularity, reliability, and observability, handling extensive data generated from their services. Key tools in their ETL processes include Apache Spark, dbt, Apache Airflow, AWS Glue, and Google Cloud Dataflow. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#data-engineering](https://daily.dev/tags/data-engineering), [#apache-spark](https://daily.dev/tags/apache-spark), [#data-processing](https://daily.dev/tags/data-processing), [#etl](https://daily.dev/tags/etl) [View this post on daily.dev](https://daily.dev/posts/how-uber-built-an-exabyte-scale-system-for-data-processing-3wz2ejth7)