--- title: Creating Data Pipelines With Apache Airflow and MinIO description: Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It was originally developed by the engineering team at... canonical: https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Creating Data Pipelines With Apache Airflow and MinIO | daily.dev og:description: Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It was originally developed by the engineering team at... og:url: https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg og:image: https://api.daily.dev/og/posts/m779NLLWG.png og:image:alt: Creating Data Pipelines With Apache Airflow and MinIO og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Creating Data Pipelines With Apache Airflow and MinIO **[Hacker Noon](https://daily.dev/sources/hackernoon)** · 1 min read · 1 upvotes · 0 comments ## Summary Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It was originally developed by the engineering team at Airbnb but was given to the Apache Software Foundation where it is licensed under Apache 2.0. MinIO is the perfect companion for Airflow because of its industry-leading performance and scalability. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#python](https://daily.dev/tags/python), [#performance](https://daily.dev/tags/performance), [#open-source](https://daily.dev/tags/open-source), [#devops](https://daily.dev/tags/devops), [#backend](https://daily.dev/tags/backend), [#cloud-native](https://daily.dev/tags/cloud-native), [#multi-cloud](https://daily.dev/tags/multi-cloud), [#data-engineering](https://daily.dev/tags/data-engineering), [#apache-kafka](https://daily.dev/tags/apache-kafka), [#apache-airflow](https://daily.dev/tags/apache-airflow) [View this post on daily.dev](https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Creating Data Pipelines With Apache Airflow and MinIO","url":"https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg"},"datePublished":"2023-10-19T17:41:06.076Z","dateModified":"2023-10-19T17:37:58.549Z","description":"Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. It was originally developed by the engineering team at...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/f7172c7ab9794f43c6442bac0f80a075?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/f7172c7ab9794f43c6442bac0f80a075?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"Hacker Noon","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Hacker Noon","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/hackernoon","url":"https://daily.dev/sources/hackernoon"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/creating-data-pipelines-with-apache-airflow-and-minio-m779nllwg","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"python,performance,open-source,devops,backend,cloud-native,multi-cloud,data-engineering,apache-kafka,apache-airflow","timeRequired":"PT1M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Hacker Noon","item":"https://daily.dev/sources/hackernoon"},{"@type":"ListItem","position":3,"name":"Creating Data Pipelines With Apache Airflow and MinIO"}]} ```