--- title: Apache Flink® on Kubernetes | daily.dev description: Airbnb transitioned its stream processing architecture from Apache Hadoop Yarn to Kubernetes. This migration improved developer velocity, job availability, and... canonical: https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Apache Flink® on Kubernetes | daily.dev og:description: Airbnb transitioned its stream processing architecture from Apache Hadoop Yarn to Kubernetes. This migration improved developer velocity, job availability, and... og:url: https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs og:image: https://api.daily.dev/og/posts/ZM56YDFHs.png og:image:alt: Apache Flink® on Kubernetes og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Apache Flink® on Kubernetes **[Airbnb](https://daily.dev/sources/airbnb)** · 11 min read · 11 upvotes · 0 comments ## Summary Airbnb transitioned its stream processing architecture from Apache Hadoop Yarn to Kubernetes. This migration improved developer velocity, job availability, and infrastructure costs. The current setup integrates Flink directly with Kubernetes, offering a better developer experience, secure secrets management, isolated environments, enhanced monitoring, and simpler service discovery. The future focus will involve improving job availability, enabling autoscaling, and utilizing the Flink Kubernetes Operator for streamlined operations. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#devops](https://daily.dev/tags/devops), [#kubernetes](https://daily.dev/tags/kubernetes), [#big-data](https://daily.dev/tags/big-data), [#apache-flink](https://daily.dev/tags/apache-flink) [View this post on daily.dev](https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Apache Flink® on Kubernetes","url":"https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs"},"datePublished":"2024-07-31T21:02:07.813Z","dateModified":"2024-07-31T21:02:25.612Z","description":"Airbnb transitioned its stream processing architecture from Apache Hadoop Yarn to Kubernetes. This migration improved developer velocity, job availability, and...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/06f382e3feae2af3de6584f28ffcc63b?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/06f382e3feae2af3de6584f28ffcc63b?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Airbnb","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Airbnb","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/airbnb","url":"https://daily.dev/sources/airbnb"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/apache-flink-on-kubernetes-zm56ydfhs","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":11},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devops,kubernetes,big-data,apache-flink","timeRequired":"PT11M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Airbnb","item":"https://daily.dev/sources/airbnb"},{"@type":"ListItem","position":3,"name":"Apache Flink® on Kubernetes"}]} ```