--- title: Best Kafka posts of 2023 | daily.dev description: The most upvoted Kafka posts of 2023, curated by the daily.dev community. canonical: https://daily.dev/tags/kafka/best-of/2023 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/kafka/best-of/2023 og:type: website og:site_name: daily.dev og:title: Best Kafka posts of 2023 | daily.dev og:description: The most upvoted Kafka posts of 2023, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Kafka — 2023 1. 1 [](/posts/ep76-netflix-s-tech-stack-dklzjrpwh "EP76: Netflix's Tech Stack") Article ByteByteGo · 3y EP76: Netflix's Tech Stack In this CEO-approved slide deck, you’ll find simple ways to communicate how your team is increasing engineering efficiency. For too many engineering leaders, the most stressful part of their job isn’t a bug or a system crash. The CTO Board Deck is your secret weapon for owning any boardroom you enter. 151 1 2. 2 [](/posts/how-to-build-a-real-time-notification-system-with-go-and-kafka-xrp4jdwgv "How to Build a Real-Time Notification System with Go and Kafka") Article freeCodeCamp · 3y How to Build a Real-Time Notification System with Go and Kafka In this tutorial, you’ll delve into the mechanics of Kafka and then integrate it with Go to develop a real-time notification system. In order to understand this article fully, you should have prior knowledge of Goroutines, the Gin framework, and containerization tools like Docker. 128 2 3. 3 [](/posts/how-to-choose-a-message-queue--npp57kfdp "How to Choose a Message Queue?") Article ByteByteGo · 3y How to Choose a Message Queue? The diagram below shows how it works: When the cashier takes an order, a new order is created in the database-backed queue. For Starbucks’ use case, a simple database queue meets the requirements without needing Kafka. RabbitMQ works like a messaging middleware - it pushes messages to consumers then deletes them upon acknowledgment. 108 4 4. 4 [](/posts/redis-vs-kafka-vs-rabbitmq-al14karsu "Redis vs Kafka vs RabbitMQ") Article Community Picks · 4y Redis vs Kafka vs RabbitMQ There are two common ways Microservices communicate with each other: Synchronous and Asynchronous. RabbitMQ was released in 2007 and is one of the first common message brokers to be created. RabbitMQ is an open-source that delivers messages through both point-to-point and pub-sub methods. 83 4 5. 5 [](/posts/kafka-vs-rabbitmq-what-are-the-differences--qaskjanlr "Kafka vs RabbitMQ: What Are the Differences?") Article Earthly · 3y Kafka vs RabbitMQ: What Are the Differences? Apache Kafka and RabbitMQ are popular distributed messaging systems with functionalities for real-time data processing, analytics, event-driven architectures, and more. Kafka is a distributed streaming platform with high throughput, low latency, and a publish-subscribe model. RabbitMQ is a message broker with support for multiple protocols and flexible routing capabilities. Kafka excels in real-time data processing, event sourcing, and log aggregation, while RabbitMQ is suitable for asynchronous communication, microservices communication, and IoT data ingestion. 80 4 6. 6 [](/posts/why-is-kafka-so-fast-how-does-it-work--bywcpiym8 "Why is Kafka so fast? How does it work?") Article ByteByteGo · 3y Why is Kafka so fast? How does it work? Kafka has emerged as a popular choice for its speed and scalability - but what exactly makes it so fast? In this issue, we'll explore: Kafka's architecture and its core components like producer, brokers, and consumers. How Kafka optimizes data storage and replication and replication. 76 1 7. 7 [](/posts/redis-vs-kafka-vs-rabbitmq-dsws5lpp1 "Redis vs Kafka vs RabbitMQ") Article JavaScript in Plain English · 3y Redis vs Kafka vs RabbitMQ Redis vs Kafka vs RabbitMQ will compare the three most popular brokers: RabbitMQ, Kafka and Redis. RabbitMQ supports all major languages, including Python, Java,.NET, PHP, Ruby, JavaScript, Go, Swift, and more. Kafka Scale: can send up to a million messages per second. 53 8. 8 [](/posts/building-real-time-applications-with-amplication-and-kafka-uisnyfkkn "Building Real-time Applications with Amplication and Kafka") Article Amplication · 3y Building Real-time Applications with Amplication and Kafka This article discusses the importance of real-time communication in modern applications and introduces Kafka as a tool for building real-time systems. It explains the components of Kafka and how it works on a publish-subscribe model. The article then demonstrates how to build an application with Kafka using Amplication, a platform that generates production-ready backend services. It provides step-by-step instructions for setting up an Amplication project, creating entities, adding a message broker and topics, configuring microservices, and adding custom Kafka communication logic. The article also highlights the benefits of using Amplication to speed up microservice development and ensure seamless event-driven communication. 47 1 9. 9 [](/posts/clean-architecture-and-indirection-no-thanks--upmnpjkrx ""Clean Architecture" and indirection. No thanks.") Article Discover .NET · 3y "Clean Architecture" and indirection. No thanks. 45 10. 10 [](/posts/event-streaming-v-s-event-sourcing-djljuib8n "Event Streaming v.s Event Sourcing") Article Towards Dev · 3y Event Streaming v.s Event Sourcing Event streaming and event sourcing are two related but distinct concepts in the world of event-driven architecture. Event streaming is the process of continuously capturing and storing events as they occur in a system. These events can then be processed and analyzed in real-time or stored for later analysis. 37 2 11. 11 [](/posts/kafka-architecture-w7a5c0vyj "Kafka Architecture") Article Community Picks · 4y Kafka Architecture This post provides an in-depth explanation of Kafka architecture, covering topics such as brokers, producers, consumers, partitions, clusters, topics, offsets, replication factor, leader-follower relationship, consumer groups, Kafka as a streaming technology, and more. It also includes sample code for a Python producer and consumer. 36 12. 12 [](/posts/biggest-scam-in-software-dev-best-practices--jyqfsbyfh "Biggest scam in software dev? Best Practices.") Article Discover .NET · 3y Biggest scam in software dev? Best Practices. CodeOpinion Sponsor: Do you build complex software systems? See how NServiceBus makes it easier to design, build, and manage software systems that use message queues to achieve loose coupling. Get started for free. What’s the biggest scam in tech that is deemed acceptable? 33 13. 13 [](/posts/10-tools-for-scaling-microservices-h1zg6pkr0 "10 Tools for Scaling Microservices") Article Cloud Native Daily · 3y 10 Tools for Scaling Microservices Helios Helios is an observability tool that plays a crucial role in scaling microservices. It provides real-time visibility and insights into the performance and health of the system. Helios supports distributed tracing to help you understand the flow of requests across different microservices in your application. 31 1 14. 14 [](/posts/mcdonald-s-journey-to-event-driven-architecture-k8-v0a0qd "McDonald’s Journey to Event-Driven Architecture") Article Discover .NET · 4y McDonald’s Journey to Event-Driven Architecture McDonald’s posted behind-the-scenes and how-it-works blog posts detailing their journey to event-driven architecture. They use a custom SDK that retrieves all the event schemas from the registry, just like the producers do. 30 15. 15 [](/posts/introduction-to-kafka-lihicdnn6 "Introduction to Kafka") Article AWS Tip · 4y Introduction to Kafka Introduction to Kafka, a publisher-subscriber messaging system that manages communication between services in a reliable manner. Topics, partitions, and brokers play key roles in the Kafka architecture. 27 16. 16 [](/posts/five-new-official-redis-clients-szahojspm "Five New Official Redis Clients") Article Redis · 3y Five New Official Redis Clients Redis now officially supports five open-source client libraries: More are on the way. Choosing one of our official Redis clients means prioritizing your development experience. We will provide a standard interface across all Redis flavors, whether you use Redis Open Source (Redis OSS) or Redis Enterprise Cloud. 18 17. 17 [](/posts/system-design-series-the-ultimate-guide-for-building-high-performance-data-streaming-systems-from-s-qdiuh33pf "System Design Series: The Ultimate Guide for Building High-Performance Data Streaming Systems from Scratch!") Article Towards Data Science · 3y System Design Series: The Ultimate Guide for Building High-Performance Data Streaming Systems from Scratch! This article discusses the process of building high-performance data streaming systems for recommendation services. It explains the need for data streaming pipelines, the challenges of data ingestion, the importance of using Apache Kafka, the steps involved in data processing, the choice of using Cassandra as a data store, and the process of querying recommendations. 17 1 18. 18 [](/posts/kafka-multiple-partitions-with-spring-boot-and-kubernetes-apzi3fr81 "Kafka Multiple Partitions with Spring Boot and Kubernetes") Article Dev Genius · 3y Kafka Multiple Partitions with Spring Boot and Kubernetes This article discusses the concepts of Kafka partitions, scalability, fault tolerance, messaging ordering, and consumer parallelism. It also provides instructions on deploying Kafka, Spring Boot applications, and Kafdrop on Kubernetes. Additionally, it demonstrates how to set up a Spring Boot producer and consumer application for Kafka. 16 19. 19 [](/posts/how-paypal-scaled-kafka-to-1-3-trillion-messages-a-day-2dfbhctpf "How PayPal Scaled Kafka to 1.3 Trillion Messages a Day") Article Quastor Daily · 3y How PayPal Scaled Kafka to 1.3 Trillion Messages a Day How PayPal Scaled Kafka to 1.3 Trillion Messages a Day, how Ryan Peterman went from an L3 at Facebook to an L6 in under 3 years (tripling his compensation) How PayPal improved Kafka cluster management with a config service, custom libraries, access control lists and more Collecting metrics on the Kafka cluster. 16 20. 20 [](/posts/domain-modeling-gone-wrong-f3sp7nk62 "Domain Modeling Gone Wrong") Article Discover .NET · 3y Domain Modeling Gone Wrong 15 21. 21 [](/posts/crud-can-be-terrible-start-capturing-intent--bj2xsqhvz "CRUD can be Terrible. Start capturing INTENT!") Article Discover .NET · 3y CRUD can be Terrible. Start capturing INTENT! 15 22. 22 [](/posts/message-broker-selection-cheat-sheet-kafka-vs-rabbitmq-vs-amazon-sqs-5frzptnho "Message broker selection cheat sheet: Kafka vs RabbitMQ vs Amazon SQS") Article habr · 4y Message broker selection cheat sheet: Kafka vs RabbitMQ vs Amazon SQS Comparison of message brokers Kafka, RabbitMQ, and SQS in terms of their architecture, message processing, durability, scalability, throughput, latency, cost, and complexity. 14 23. 23 [](/posts/performance-of-kafka-consumers-1-billion-messages-h8km-qkxq "Performance of Kafka Consumers: 1 Billion messages") Article Trendyol Tech · 4y Performance of Kafka Consumers: 1 Billion messages Python and Go users can create a consumer in Python and Go. Consumers will search in Topic with the specific key I provided. They will create threads equal to the partition count of the Topic. They will run as parallelly. For instance, a topic has ten partitions, then I will create ten threads. 13 24. 24 [](/posts/how-airbnb-built-a-low-latency-highly-scalable-key-value-store-hncpzu8es "How Airbnb Built a Low Latency, Highly Scalable Key Value Store") Article Quastor Daily · 4y How Airbnb Built a Low Latency, Highly Scalable Key Value Store Airbnb built a highly scalable key value store that they could use to serve data for their ML applications. The Architecture of Airbnb’s Distributed Key Value Store was sponsored by Spotify. We talk about building a culture around automated testing and strategies Spotify uses for large scale migrations. 14 25. 25 [](/posts/introduction-to-kafka-connect-czevgsx44 "Introduction to Kafka Connect") Article Red Hat Developer · 3y Introduction to Kafka Connect Introduction to Kafka Connect, a scalable and reliable integration system for building data pipelines. It provides a pluggable architecture, declarative pipeline definition, and is part of the Apache Kafka project. 12 [See all Kafka archives](/tags/kafka/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/kafka/best-of/2023#page","url":"https://daily.dev/tags/kafka/best-of/2023","name":"Best Kafka Posts of 2023","description":"The most upvoted Kafka posts of 2023, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/kafka/best-of/2023#items","numberOfItems":25,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/ep76-netflix-s-tech-stack-dklzjrpwh","name":"EP76: Netflix's Tech Stack"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/how-to-build-a-real-time-notification-system-with-go-and-kafka-xrp4jdwgv","name":"How to Build a Real-Time Notification System with Go and Kafka"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/how-to-choose-a-message-queue--npp57kfdp","name":"How to Choose a Message Queue?"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/redis-vs-kafka-vs-rabbitmq-al14karsu","name":"Redis vs Kafka vs RabbitMQ"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/kafka-vs-rabbitmq-what-are-the-differences--qaskjanlr","name":"Kafka vs RabbitMQ: What Are the Differences?"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/why-is-kafka-so-fast-how-does-it-work--bywcpiym8","name":"Why is Kafka so fast? How does it work?"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/redis-vs-kafka-vs-rabbitmq-dsws5lpp1","name":"Redis vs Kafka vs RabbitMQ"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/building-real-time-applications-with-amplication-and-kafka-uisnyfkkn","name":"Building Real-time Applications with Amplication and Kafka"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/clean-architecture-and-indirection-no-thanks--upmnpjkrx","name":"\"Clean Architecture\" and indirection. No thanks."},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/event-streaming-v-s-event-sourcing-djljuib8n","name":"Event Streaming v.s Event Sourcing"},{"@type":"ListItem","position":11,"url":"https://daily.dev/posts/kafka-architecture-w7a5c0vyj","name":"Kafka Architecture"},{"@type":"ListItem","position":12,"url":"https://daily.dev/posts/biggest-scam-in-software-dev-best-practices--jyqfsbyfh","name":"Biggest scam in software dev? Best Practices."},{"@type":"ListItem","position":13,"url":"https://daily.dev/posts/10-tools-for-scaling-microservices-h1zg6pkr0","name":"10 Tools for Scaling Microservices"},{"@type":"ListItem","position":14,"url":"https://daily.dev/posts/mcdonald-s-journey-to-event-driven-architecture-k8-v0a0qd","name":"McDonald’s Journey to Event-Driven Architecture"},{"@type":"ListItem","position":15,"url":"https://daily.dev/posts/introduction-to-kafka-lihicdnn6","name":"Introduction to Kafka"},{"@type":"ListItem","position":16,"url":"https://daily.dev/posts/five-new-official-redis-clients-szahojspm","name":"Five New Official Redis Clients"},{"@type":"ListItem","position":17,"url":"https://daily.dev/posts/system-design-series-the-ultimate-guide-for-building-high-performance-data-streaming-systems-from-s-qdiuh33pf","name":"System Design Series: The Ultimate Guide for Building High-Performance Data Streaming Systems from Scratch!"},{"@type":"ListItem","position":18,"url":"https://daily.dev/posts/kafka-multiple-partitions-with-spring-boot-and-kubernetes-apzi3fr81","name":"Kafka Multiple Partitions with Spring Boot and Kubernetes"},{"@type":"ListItem","position":19,"url":"https://daily.dev/posts/how-paypal-scaled-kafka-to-1-3-trillion-messages-a-day-2dfbhctpf","name":"How PayPal Scaled Kafka to 1.3 Trillion Messages a Day"},{"@type":"ListItem","position":20,"url":"https://daily.dev/posts/domain-modeling-gone-wrong-f3sp7nk62","name":"Domain Modeling Gone Wrong"},{"@type":"ListItem","position":21,"url":"https://daily.dev/posts/crud-can-be-terrible-start-capturing-intent--bj2xsqhvz","name":"CRUD can be Terrible. Start capturing INTENT!"},{"@type":"ListItem","position":22,"url":"https://daily.dev/posts/message-broker-selection-cheat-sheet-kafka-vs-rabbitmq-vs-amazon-sqs-5frzptnho","name":"Message broker selection cheat sheet: Kafka vs RabbitMQ vs Amazon SQS"},{"@type":"ListItem","position":23,"url":"https://daily.dev/posts/performance-of-kafka-consumers-1-billion-messages-h8km-qkxq","name":"Performance of Kafka Consumers: 1 Billion messages"},{"@type":"ListItem","position":24,"url":"https://daily.dev/posts/how-airbnb-built-a-low-latency-highly-scalable-key-value-store-hncpzu8es","name":"How Airbnb Built a Low Latency, Highly Scalable Key Value Store"},{"@type":"ListItem","position":25,"url":"https://daily.dev/posts/introduction-to-kafka-connect-czevgsx44","name":"Introduction to Kafka Connect"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Kafka","item":"https://daily.dev/tags/kafka"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/kafka/best-of"},{"@type":"ListItem","position":5,"name":"2023"}]}]} ```