--- title: Uforwarder: Uber's Scalable Kafka Consumer Proxy for... description: Uber has open-sourced uForwarder, a Kafka consumer proxy built to handle trillions of messages and petabytes of data daily across thousands of downstream... canonical: https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Uforwarder: Uber's Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices | daily.dev og:description: Uber has open-sourced uForwarder, a Kafka consumer proxy built to handle trillions of messages and petabytes of data daily across thousands of downstream... og:url: https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e og:image: https://api.daily.dev/og/posts/NOSp6Xv2e.png og:image:alt: Uforwarder: Uber's Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Uforwarder: Uber's Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices **[Collections](https://daily.dev/sources/collections)** · 1 min read · 11 upvotes · 0 comments ## Summary Uber has open-sourced uForwarder, a Kafka consumer proxy built to handle trillions of messages and petabytes of data daily across thousands of downstream services. It replaces direct Kafka consumer clients with a gRPC-based push interface that centralizes offset management. Key features include context-aware routing via Kafka message headers for workload isolation, an out-of-order commit tracker with dead letter queue support to prevent head-of-line blocking, auto-rebalancing based on real-time CPU/memory/throughput metrics, and a DelayProcessManager for partition-level pause/resume control. The result is improved hardware utilization, reduced consumer lag, and better workload isolation at massive scale. ## Content Uber has introduced uForwarder, a powerful Kafka consumer proxy, into the open-source community. Designed for efficiency in event-driven microservices architectures, uForwarder seamlessly manages the immense scale of Uber's data processing needs, handling trillions of messages and petabytes daily across over a thousand downstream consumer services. Replacing traditional direct Kafka consumer client implementations, uForwarder utilizes a gRPC-driven push interface, which simplifies consumer logic by centralizing offset management. This strategic design addresses various operational challenges while optimizing resource utilization. Among its notable features is context-aware routing facilitated by Kafka message headers, allowing for effective workload isolation without necessitating topic proliferation. To further enhance processing efficiency, the system incorporates an out-of-order commit tracker, which redirects stalled messages to a dead letter queue, mitigating issues of head-of-line blocking. uForwarder also boasts a sophisticated auto-rebalancing mechanism that dynamically redistributes partitions according to real-time metrics such as CPU usage, memory load, and throughput. Additionally, the DelayProcessManager offers granular partition-level control, enabling the pausing and resumption of message processing as needed. Through these innovative features, Uber's uForwarder significantly improves hardware utilization, reduces consumer lag, and effectively isolates workloads across different environments, making it a robust solution for large-scale event-driven and microservices architectures. ## Similar posts on daily.dev - [Uber Moves In-House Search Indexing to Pull-Based Ingestion in OpenSearch](https://daily.dev/posts/uber-moves-in-house-search-indexing-to-pull-based-ingestion-in-opensearch-usfyr37v3) · InfoQ · 0 upvotes · 0 comments - [Uber Launches IngestionNext: Streaming-First Data Lake Cuts Latency and Compute by 25%](https://daily.dev/posts/uber-launches-ingestionnext-streaming-first-data-lake-cuts-latency-and-compute-by-25--fziocip6a) · InfoQ · 6 upvotes · 0 comments --- Tags: [#architecture](https://daily.dev/tags/architecture), [#microservices](https://daily.dev/tags/microservices), [#kafka](https://daily.dev/tags/kafka), [#uber](https://daily.dev/tags/uber), [#grpc](https://daily.dev/tags/grpc) [View this post on daily.dev](https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Uforwarder: Uber's Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices","url":"https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e"},"datePublished":"2026-02-23T15:07:43.276Z","dateModified":"2026-02-27T02:48:52.883Z","description":"Uber has open-sourced uForwarder, a Kafka consumer proxy built to handle trillions of messages and petabytes of data daily across thousands of downstream...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/3fd15d222e19e336d135c7a79176bbce?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/3fd15d222e19e336d135c7a79176bbce?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Collections","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Collections","logo":"https://media.daily.dev/image/upload/s--fk_6ycEi--/f_auto,q_auto/v1780996001/logos/collections?_a=BAMAMiWQ0","url":"https://daily.dev/sources/collections"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/uforwarder-uber-s-scalable-kafka-consumer-proxy-for-efficient-event-driven-microservices-nosp6xv2e","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":11},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"architecture,microservices,kafka,uber,grpc","timeRequired":"PT1M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Collections","item":"https://daily.dev/sources/collections"},{"@type":"ListItem","position":3,"name":"Uforwarder: Uber's Scalable Kafka Consumer Proxy for Efficient Event-Driven Microservices"}]} ```