--- title: Best Kafka posts of 2022 | daily.dev description: The most upvoted Kafka posts of 2022, curated by the daily.dev community. canonical: https://daily.dev/tags/kafka/best-of/2022 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/kafka/best-of/2022 og:type: website og:site_name: daily.dev og:title: Best Kafka posts of 2022 | daily.dev og:description: The most upvoted Kafka posts of 2022, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Kafka — 2022 1. 1 [](/posts/netflix-system-design--backend-architecture-g2q-lrrvj "Netflix System Design- Backend Architecture") Article Community Picks · 4y Netflix System Design- Backend Architecture Netflix accounts for about 15% of the world's internet bandwidth traffic. Netflix operates in two clouds Amazon Web Services and Open Connect (Netflix content delivery network) The overall Netflix system consists of three main parts. Zuul as its API gateway is built to allow dynamic routing, traffic monitoring, and security, resilience to The Netty handlers on the front and back of the filters. 742 32 2. 2 [](/posts/the-complete-guide-to-system-design-in-2022-lfzjtayhf "The complete guide to System Design in 2022") Article Community Picks · 4y The complete guide to System Design in 2022 System Design is the process of defining the architecture, interfaces, and data for a system that satisfies specific requirements. System design meets the needs of your business or organization through coherent and efficient systems. The complete guide to System Design Interview in 2022 is available. 219 9 3. 3 [](/posts/best-practices-for-scaling-your-node-js-rest-apis-4nu2ywmmo "Best Practices for Scaling Your Node.js REST APIs") Article freeCodeCamp · 4y Best Practices for Scaling Your Node.js REST APIs Use throttling at the first junction point between your application and the News Feed Service. Use the ELK stack for setting up a good logging and alerting pipeline. If a request goes through multiple services during the lifecycle, you can pass along a unique ID in the logs to capture a particular request across all the services. 180 20 4. 4 [](/posts/microservices-with-nestjs-kafka-and-typescript-kwbbuo6p9 "Microservices with NestJS, Kafka, and TypeScript") Article LogRocket · 4y Microservices with NestJS, Kafka, and TypeScript The microservices architecture is an increasingly popular architecture pattern that follows the SOA (Service Oriented Architecture) concept. This guide will demonstrate how to build microservices using NestJS, Kafka, and TypeScript. You will create an authentication microservice to create and save user details. 83 2 5. 5 [](/posts/how-mcdonalds-implements-event-driven-architectures-zzq-qw7ba "How McDonalds implements Event Driven Architectures") Article Quastor Daily · 4y How McDonalds implements Event Driven Architectures McDonalds has the most downloaded restaurant app in the United States, with over 24 million downloads in 2021\. For their backend, McDonalds relies on event driven architectures (EDAs) for many of their services. McDonalds wanted to build a unified eventing platform that could manage the communication between different producers and consumer services at the company. 78 2 6. 6 [](/posts/just-use-postgres-for-everything-5is4i1gy3 "Just Use Postgres for Everything") Article Hacker News · 4y Just Use Postgres for Everything Use Postgres for everything is a tradeoff, says Stephan As a CTO, Interim CTO and CTO Coach. Postgres can replace - up to millions of users - many backend technologies, such as Kafka, RabbitMQ, Mongo and Redis among them. 73 4 7. 7 [](/posts/why-you-should-learn-apache-kafka-pwzfwdarg "Why you should learn Apache Kafka") Article Faun · 5y Why you should learn Apache Kafka Kafka is an event streaming platform. It is one of the most popular events streaming platforms used by various industry giants including NETFLIX, PayPal, Spotify, Twitter and Airbnb. Kafka has topics, to which the producers will push events and the end consumers will keep polling for new messages on that topic. 27 8. 8 [](/posts/kafka-or-rabbitmq-what-to-use-when-mzuaa-qjt "Kafka or RabbitMQ: What to Use When") Article Towards Dev · 4y Kafka or RabbitMQ: What to Use When Distributed messaging is based on the concept of reliable message queuing. Messages are queued asynchronously between client applications and messaging system. RabbitMQ is the ordinary queue management protocol (mainly using FIFO). Kafka also act as almost same but more than that we consider it as a stream processing system. 26 9. 9 [](/posts/the-best-open-source-software-of-2022-preiof05t "The best open source software of 2022") Article InfoWorld · 4y The best open source software of 2022 The best open source software of 2022 InfoWorld’s 2022 Bossie Awards celebrate the most important and innovative application development, devops, data analytics, and machine learning tools of the year. SvelteKit and Nuxt, as well as newer entrants like Blitz.js, are exploring new approaches and techniques. 24 10. 10 [](/posts/event-driven-architecture-5-pitfalls-to-avoid-mtf5ingev "Event Driven Architecture — 5 Pitfalls to Avoid") Article Pointer · 4y Event Driven Architecture — 5 Pitfalls to Avoid At Wix we have been gradually migrating our growing set of microservices from the request-reply pattern to event driven architecture over the last few years. Below there are 5 pitfalls that Wix engineers have encountered during our experimentation with event-driven architecture. 24 11. 11 [](/posts/kafka-everything-you-need-to-know-zmll6y89 "Kafka: Everything you need to know") Article Dev Genius · 4y Kafka: Everything you need to know Kafka offers much higher performance than message brokers like RabbitMQ. It uses sequential disk I/O to boost performance, making it a suitable option for implementing queues. It can achieve high throughput (millions of messages per second) with limited resources, a necessity for big data use cases. 22 1 12. 12 [](/posts/why-kafka-is-the-future-of-messaging-v3f-qgodd "Why Kafka is the Future of Messaging") Article Section · 4y Why Kafka is the Future of Messaging Apache Kafka is a distributed, partitioned, replicated commit log service. It helps you process a large amount of data through the use of various Kafka consumers. It can be used as the central nervous system of a distributed architecture that delivers data to multiple systems. The primary reason behind developing Apache Kafka was to serve companies with fast and efficient data pipelines. 22 13. 13 [](/posts/build-a-durable-pub-sub-with-kafka-in-node-js-ltgxko40f "Build a durable pub-sub with Kafka in Node.js") Article LogRocket · 4y Build a durable pub-sub with Kafka in Node.js Kafka helps you build durable, fault-tolerant, and scalable data pipelines. In this article, we will understand what Kafka pub-sub is, how it helps, and how to start using it in your Node.js API. 20 14. 14 [](/posts/introduction-to-apache-kafka-fundamentals-and-working---jbehkjfcv "Introduction to Apache Kafka: Fundamentals and Working -") Article Analytics Vidhya · 4y Introduction to Apache Kafka: Fundamentals and Working - Kafka is a distributed, real-time streaming platform for large-scale data processing. It uses Kafka for many things, such as computing the cab fare in real time depending on the demand, destination, and availability of cabs. Kafka is an evolution of pub-sub messaging where messages are stored and transformed as they occur. 16 15. 15 [](/posts/ep31-super-high-performance-nosql-and-mq-4epe2utdj "EP31: Super High-performance NoSQL and MQ") Article ByteByteGo · 4y EP31: Super High-performance NoSQL and MQ The data platform ingests, processes, analyzes and presents data generated by different data sources. No JVM, No GC Kafka and Cassandra are written in JVM-compatible languages and usually suffer from high tail latency. Redpanda and ScyllaDB are rewritten from scratch using C++ and leverages some new frameworks. 16 1 16. 16 [](/posts/get-started-with-kafka-and-docker-in-20-minutes-b4wf1uelf "Get Started With Kafka and Docker in 20 Minutes") Article DZone · 4y Get Started With Kafka and Docker in 20 Minutes Kafka runs on the platform of your choice, such as Kubernetes or ECS, as a cluster of one or more Kafka nodes. A Kafka cluster will be initialized with zero or more topics, which you can think of as message channels or queues. Create the Dockerfile alongside the other three files that were just created and add the following: Dockerfile. Save and close. Subsequent commands will be run in this folder. 16 17. 17 [](/posts/apache-kafka-architecture-and-use-cases-explained-uarnwbrlj "Apache Kafka Architecture and Use Cases Explained") Article Analytics Vidhya · 4y Apache Kafka Architecture and Use Cases Explained Kafka is a distributed publish-subscribe messaging system. It has a full queue that can accept large amounts of message data. Kafka is used by big internet companies like LinkedIn, Twitter, Airbnb, and many others. This article was published as a part of the Data Science Blogathon. 16 18. 18 [](/posts/building-rust-microservices-with-apache-kafka-fw8--l4uq "Building Rust microservices with Apache Kafka") Article LogRocket · 4y Building Rust microservices with Apache Kafka Kafka-based microservices built with Rust usually have one or more producers and consumers. In this article, you’ll learn how to build a microservice using Rust with Kafka. The producer is connected to your local server at localhost:9092\. The consumer we created above reads events published to the topic- Name topic and prints the event’s message to the console. It works in more detail. The consumer is created. 14 19. 19 [](/posts/building-a-search-index-with-kafka-and-elasticsearch--7rj9hedu "Building a Search Index with Kafka and Elasticsearch") Article Quastor Daily · 5y Building a Search Index with Kafka and Elasticsearch How computers in a distributed system synchronize their clocks. How computers do this using NTP (Network Time Protocol) Brief overview of how NTP works. How DoorDash Built a Faster Indexing System for their Search feature. Using Kafka as a message queue, Apache Flink for data transformation and Elasticsearch as the search engine. 13 20. 20 [](/posts/how-we-reduce-our-streaming-cost-by-90-using-benthos-vklcotlee "How we reduce our Streaming cost by 90% using Benthos") Article Medium · 4y How we reduce our Streaming cost by 90% using Benthos Benthos is a brand new open-source data streaming service that is written in GO. It's based on GO instead of JVM, which gives it outstanding performance, native support for K8S, and all the connectors/sinks you can think of. The deployment is fully scalable and will scale up & down. 12 21. 21 [](/posts/netflix-builds-a-custom-high-throughput-priority-queue-backed-by-redis-kafka-and-elasticsearch-ffzbw62nr "Netflix Builds a Custom High-Throughput Priority Queue Backed by Redis, Kafka and Elasticsearch") Article InfoQ · 4y Netflix Builds a Custom High-Throughput Priority Queue Backed by Redis, Kafka and Elasticsearch Netflix built Timestone, a custom high-throughput, low-latency priority queueing system. Netflix built the queuing system using open-source components such as Redis, Apache Kafka, Apache Flink and Elasticsearch. 12 22. 22 [](/posts/3-simple-steps-to-set-up-kafka-locally-using-docker-bfbzetg91 "3 Simple steps to set up Kafka locally using Docker") Article Towards Dev · 5y 3 Simple steps to set up Kafka locally using Docker Make sure that you have Docker installed on your machine. Download the spotify/kafka image and run the image as a docker container. Create your very first Kafka topic: There are currently no topics present on the Kafka broker, you can go ahead and create one to see if everything works as expected. 12 23. 23 [](/posts/using-kafka-for-system-integration-nhe2pvx7x "Using Kafka For System Integration") Article Dev Genius · 5y Using Kafka For System Integration Use Kafka to connect multiple systems that are on different machines or different networks. Using Kafka For System Integration Tosho Todorovski shares his tips on how to use the service on a Linux server on Microsoft's Azure platform. The first step is to create a dedicated user for the service. 12 1 24. 24 [](/posts/the-most-undervalued-skill-of-programmers-hv3-b6sqy "The Most Undervalued Skill of Programmers") Article Hashnode · 4y The Most Undervalued Skill of Programmers Programmers are always learning. Whether it's learning a new language, a new framework, design patterns, or even a keyboard shortcut. It makes them and their team more productive, saving valuable time for their company. But we rarely talk about the skill of making code easy to understand. 11 1 25. 25 [](/posts/communicate-between-microservices-with-apache-kafka--5ofgj1og "Communicate Between Microservices with Apache Kafka") Article Okta Dev · 4y Communicate Between Microservices with Apache Kafka Communicate between microservices with Apache Kafka Communicate Between Microservices with Kafka. This model can exhibit low latency but only works if services are made highly available. In your jhipster-kafka folder, import this file with the following command: Jhipster jdl apps. In the project folder, create a sub-generator. 10 [See all Kafka archives](/tags/kafka/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/kafka/best-of/2022#page","url":"https://daily.dev/tags/kafka/best-of/2022","name":"Best Kafka Posts of 2022","description":"The most upvoted Kafka posts of 2022, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/kafka/best-of/2022#items","numberOfItems":25,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/netflix-system-design--backend-architecture-g2q-lrrvj","name":"Netflix System Design- Backend Architecture"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/the-complete-guide-to-system-design-in-2022-lfzjtayhf","name":"The complete guide to System Design in 2022"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/best-practices-for-scaling-your-node-js-rest-apis-4nu2ywmmo","name":"Best Practices for Scaling Your Node.js REST APIs"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/microservices-with-nestjs-kafka-and-typescript-kwbbuo6p9","name":"Microservices with NestJS, Kafka, and TypeScript"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/how-mcdonalds-implements-event-driven-architectures-zzq-qw7ba","name":"How McDonalds implements Event Driven Architectures"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/just-use-postgres-for-everything-5is4i1gy3","name":"Just Use Postgres for Everything"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/why-you-should-learn-apache-kafka-pwzfwdarg","name":"Why you should learn Apache Kafka"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/kafka-or-rabbitmq-what-to-use-when-mzuaa-qjt","name":"Kafka or RabbitMQ: What to Use When"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/the-best-open-source-software-of-2022-preiof05t","name":"The best open source software of 2022"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/event-driven-architecture-5-pitfalls-to-avoid-mtf5ingev","name":"Event Driven Architecture — 5 Pitfalls to Avoid"},{"@type":"ListItem","position":11,"url":"https://daily.dev/posts/kafka-everything-you-need-to-know-zmll6y89","name":"Kafka: Everything you need to know"},{"@type":"ListItem","position":12,"url":"https://daily.dev/posts/why-kafka-is-the-future-of-messaging-v3f-qgodd","name":"Why Kafka is the Future of Messaging"},{"@type":"ListItem","position":13,"url":"https://daily.dev/posts/build-a-durable-pub-sub-with-kafka-in-node-js-ltgxko40f","name":"Build a durable pub-sub with Kafka in Node.js"},{"@type":"ListItem","position":14,"url":"https://daily.dev/posts/introduction-to-apache-kafka-fundamentals-and-working---jbehkjfcv","name":"Introduction to Apache Kafka: Fundamentals and Working -"},{"@type":"ListItem","position":15,"url":"https://daily.dev/posts/ep31-super-high-performance-nosql-and-mq-4epe2utdj","name":"EP31: Super High-performance NoSQL and MQ"},{"@type":"ListItem","position":16,"url":"https://daily.dev/posts/get-started-with-kafka-and-docker-in-20-minutes-b4wf1uelf","name":"Get Started With Kafka and Docker in 20 Minutes"},{"@type":"ListItem","position":17,"url":"https://daily.dev/posts/apache-kafka-architecture-and-use-cases-explained-uarnwbrlj","name":"Apache Kafka Architecture and Use Cases Explained"},{"@type":"ListItem","position":18,"url":"https://daily.dev/posts/building-rust-microservices-with-apache-kafka-fw8--l4uq","name":"Building Rust microservices with Apache Kafka"},{"@type":"ListItem","position":19,"url":"https://daily.dev/posts/building-a-search-index-with-kafka-and-elasticsearch--7rj9hedu","name":"Building a Search Index with Kafka and Elasticsearch"},{"@type":"ListItem","position":20,"url":"https://daily.dev/posts/how-we-reduce-our-streaming-cost-by-90-using-benthos-vklcotlee","name":"How we reduce our Streaming cost by 90% using Benthos"},{"@type":"ListItem","position":21,"url":"https://daily.dev/posts/netflix-builds-a-custom-high-throughput-priority-queue-backed-by-redis-kafka-and-elasticsearch-ffzbw62nr","name":"Netflix Builds a Custom High-Throughput Priority Queue Backed by Redis, Kafka and Elasticsearch"},{"@type":"ListItem","position":22,"url":"https://daily.dev/posts/3-simple-steps-to-set-up-kafka-locally-using-docker-bfbzetg91","name":"3 Simple steps to set up Kafka locally using Docker"},{"@type":"ListItem","position":23,"url":"https://daily.dev/posts/using-kafka-for-system-integration-nhe2pvx7x","name":"Using Kafka For System Integration"},{"@type":"ListItem","position":24,"url":"https://daily.dev/posts/the-most-undervalued-skill-of-programmers-hv3-b6sqy","name":"The Most Undervalued Skill of Programmers"},{"@type":"ListItem","position":25,"url":"https://daily.dev/posts/communicate-between-microservices-with-apache-kafka--5ofgj1og","name":"Communicate Between Microservices with Apache Kafka"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Kafka","item":"https://daily.dev/tags/kafka"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/tags/kafka/best-of"},{"@type":"ListItem","position":5,"name":"2022"}]}]} ```