--- title: "How Github Rebuilt Their Push Processing System" url: https://daily.dev/posts/how-github-rebuilt-their-push-processing-system-9jgynk4ev source_url: https://blog.quastor.org/p/how-github-rebuilt-their-push-processing-system type: article source: "Quastor Daily" published: 2025-01-24T16:18:42.099Z updated: 2025-01-24T16:24:18.752Z tags: ["github", "architecture", "microservices", "kafka"] reading_time: 6 upvotes: 1 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # How Github Rebuilt Their Push Processing System **[Quastor Daily](https://daily.dev/sources/quastor)** · 6 min read · 1 upvotes · 0 comments ## Summary GitHub rebuilt their push processing system from a monolithic, tightly coupled architecture to a more decoupled architecture using Apache Kafka. The new system improves scalability, fault isolation, and reduces latency. The old system, based on a single large job, faced issues like difficulty with retries, broad impact of failures, and slow processing times. The new system processes independent jobs separately, resulting in higher reliability and smaller failure impact. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#github](https://daily.dev/tags/github), [#architecture](https://daily.dev/tags/architecture), [#microservices](https://daily.dev/tags/microservices), [#kafka](https://daily.dev/tags/kafka) [View this post on daily.dev](https://daily.dev/posts/how-github-rebuilt-their-push-processing-system-9jgynk4ev)