--- title: Message Queues in System Design | daily.dev description: Message queues are durable components that support asynchronous communication, helping to decouple events and handle tasks without immediate processing. This... canonical: https://daily.dev/posts/message-queues-in-system-design-2p8uriivz twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Message Queues in System Design | daily.dev og:description: Message queues are durable components that support asynchronous communication, helping to decouple events and handle tasks without immediate processing. This... og:url: https://daily.dev/posts/message-queues-in-system-design-2p8uriivz og:image: https://api.daily.dev/og/posts/2P8UrIIVz.png og:image:alt: Message Queues in System Design og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Message Queues in System Design **[gitconnected](https://daily.dev/sources/gc)** · 4 min read · 1261 upvotes · 29 comments ## Summary Message queues are durable components that support asynchronous communication, helping to decouple events and handle tasks without immediate processing. This allows better scalability and durability, especially under high traffic. Different types of queues like FIFO and priority queues, as well as different models like push-based and pull-based queues, provide versatile solutions for various needs. Examples of message queues include RabbitMQ for versatility, Kafka for high throughput, and Amazon SQS for managed cloud-based services. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Community discussion Top comments from developers on daily.dev. **@lalithkishore** · 4 upvotes > Damn helpful, thank you! **@erikdreyer** · 2 upvotes > I recently used queues for inter-process and thread communication for a super fast TCP application in Python. > > Yes, yes Python was never made for this. But I needed native plots, which arent Qt or web technology based, as I needed native UI and didn't want to struggled with CSS as an embedded dev. > > It really worked well. I actually passed dictionaries in the queues, where the "command" field was the actual function name and I used getattr to call the function from a string. This allowed me to define callbacks and "on-*" events. I could also add *args and **kwargs easily. **@jsnelders** · 2 upvotes > This is one of the easiest to understand intros to queues I've read. Nice! **@liyakatshaikh** · 2 upvotes > Awesome!! **@laenderoliveira** · 1 upvotes > Awesome ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments - [CNCF Unveils Schedule for KubeCon \+ CloudNativeCon Europe 2026](https://daily.dev/posts/cncf-unveils-schedule-for-kubecon-cloudnativecon-europe-2026-ikhcoa5cb) · CNCF · 2 upvotes · 0 comments - [CNCF Debuts KubeCon \+ CloudNativeCon Japan 2026 Schedule](https://daily.dev/posts/cncf-debuts-kubecon-cloudnativecon-japan-2026-schedule-xp5pyudub) · CNCF · 1 upvotes · 0 comments --- Tags: [#architecture](https://daily.dev/tags/architecture), [#career](https://daily.dev/tags/career), [#distributed-systems](https://daily.dev/tags/distributed-systems), [#kafka](https://daily.dev/tags/kafka), [#rabbitmq](https://daily.dev/tags/rabbitmq) [View this post on daily.dev](https://daily.dev/posts/message-queues-in-system-design-2p8uriivz) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Message Queues in System Design","url":"https://daily.dev/posts/message-queues-in-system-design-2p8uriivz","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/message-queues-in-system-design-2p8uriivz"},"datePublished":"2024-08-27T18:44:52.232Z","dateModified":"2024-11-16T02:16:39.145Z","description":"Message queues are durable components that support asynchronous communication, helping to decouple events and handle tasks without immediate processing. This...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d523128ee522ead69b959c8bcdc1fc60?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d523128ee522ead69b959c8bcdc1fc60?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"gitconnected","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"gitconnected","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/gc","url":"https://daily.dev/sources/gc"},"commentCount":29,"discussionUrl":"https://daily.dev/posts/message-queues-in-system-design-2p8uriivz","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1261},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":29}],"keywords":"architecture,career,distributed-systems,kafka,rabbitmq","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"gitconnected","item":"https://daily.dev/sources/gc"},{"@type":"ListItem","position":3,"name":"Message Queues in System Design"}]} {"@context":"https://schema.org","@type":"WebPage","@id":"https://daily.dev/posts/message-queues-in-system-design-2p8uriivz","comment":[{"@type":"Comment","text":"Damn helpful, thank you!","datePublished":"2024-08-27T19:37:07.851Z","url":"https://daily.dev/posts/2P8UrIIVz#c-TygtgsAMs","author":{"@type":"Person","name":"Lalith Kishore","url":"https://daily.dev/lalithkishore","image":"https://lh3.googleusercontent.com/a/ACg8ocIX-2abUtyBFXZFVDFcSCUZ8YBKP6Yy-XDOB15g5TGBCGmcdnk=s96-c"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":4}},{"@type":"Comment","text":"I recently used queues for inter-process and thread communication for a super fast TCP application in Python.\nYes, yes Python was never made for this. But I needed native plots, which arent Qt or web technology based, as I needed native UI and didn’t want to struggled with CSS as an embedded dev.\nIt really worked well. I actually passed dictionaries in the queues, where the “command” field was the actual function name and I used getattr to call the function from a string. This allowed me to define callbacks and “on-*” events. I could also add *args and **kwargs easily.","datePublished":"2024-09-01T04:16:00.588Z","url":"https://daily.dev/posts/2P8UrIIVz#c-8hustv0OF","author":{"@type":"Person","name":"Erik","url":"https://daily.dev/erikdreyer","image":"https://media.daily.dev/image/upload/s--O0TOmw4y--/f_auto/v1715772965/public/noProfile"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2}},{"@type":"Comment","text":"This is one of the easiest to understand intros to queues I’ve read. Nice!","datePublished":"2024-08-29T00:07:39.983Z","url":"https://daily.dev/posts/2P8UrIIVz#c-t74KnLrBp","author":{"@type":"Person","name":"Jason","url":"https://daily.dev/jsnelders","image":"https://media.daily.dev/image/upload/s--O0TOmw4y--/f_auto/v1715772965/public/noProfile"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2}},{"@type":"Comment","text":"Awesome!!","datePublished":"2024-08-28T06:35:20.517Z","url":"https://daily.dev/posts/2P8UrIIVz#c-FX7StrpRP","author":{"@type":"Person","name":"Liyakat Shaikh","url":"https://daily.dev/liyakatshaikh","image":"https://lh3.googleusercontent.com/a/ACg8ocKaTxBVnmVWHRSmC97BL2MJsr3pP7MEAw20mt5b4oYY4DHFE7Eg=s96-c"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2}},{"@type":"Comment","text":"Awesome","datePublished":"2024-08-28T11:22:16.267Z","dateModified":"2024-08-28T11:22:47.754Z","url":"https://daily.dev/posts/2P8UrIIVz#c-FkWG7WS9H","author":{"@type":"Person","name":"Laender Oliveira","url":"https://daily.dev/laenderoliveira","image":"https://avatars.githubusercontent.com/u/10435417?v=4"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1}}]} ```