--- title: Best Data Engineer Things posts — May 2025 | daily.dev description: The most upvoted Data Engineer Things posts from May 2025, curated by the daily.dev community. canonical: https://daily.dev/sources/detlife/best-of/2025/05 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/sources/detlife/best-of/2025/05 og:type: website og:site_name: daily.dev og:title: Best Data Engineer Things posts — May 2025 | daily.dev og:description: The most upvoted Data Engineer Things posts from May 2025, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Data Engineer Things — May 2025 1. 1 [](https://daily.dev/posts/airflow-3-and-airflow-ai-sdk-in-action-analyzing-league-of-legends-jlk5tztf9 "Airflow 3 and Airflow AI SDK in Action — Analyzing League of Legends") Article Data Engineer Things · 1y Airflow 3 and Airflow AI SDK in Action — Analyzing League of Legends This post demonstrates how to create an end-to-end data pipeline using Airflow 3 and the Airflow AI SDK to analyze League of Legends data. It covers setting up the environment, exploring the Riot Games API, building a Python client for API interaction, and using AI to generate a champion tier list. The pipeline showcases modern Airflow features like Dynamic Task Mapping and emphasizes newer AI integration capabilities with Large Language Models. 21 1 2. 2 [](https://daily.dev/posts/from-gis-to-data-engineering-mastering-docker-fundamentals-and-best-practices-arnrbop7i "From GIS to Data Engineering: Mastering Docker Fundamentals and Best Practices") Article Data Engineer Things · 1y From GIS to Data Engineering: Mastering Docker Fundamentals and Best Practices The post details a geospatial professional's transition into data engineering by mastering Docker fundamentals and best practices. It covers key aspects such as Docker setup, container security, resource management, and the use of Docker Compose for production-ready environments. It also highlights the importance of secure configuration and iteration in system design, using real-world examples of data pipeline implementation and containerization strategies. 21 3. 3 [](https://daily.dev/posts/building-etl-pipeline-using-google-cloud-storage-7ynwfcqnh "Building ETL pipeline using Google Cloud Storage") Article Data Engineer Things · 1y Building ETL pipeline using Google Cloud Storage The post provides a guide on creating a simple ETL pipeline using Google Cloud Storage to process Zomato restaurant data from Kaggle. It involves extracting, transforming, and loading the data using Python and Google Cloud Storage, offering insights suitable for beginners in data engineering. Key improvements include automation, extension to other cloud services, dashboarding, and data validation. 10 [See all Data Engineer Things archives](/sources/detlife/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/sources/detlife/best-of/2025/05#page","url":"https://daily.dev/sources/detlife/best-of/2025/05","name":"Best Data Engineer Things Posts — May 2025","description":"The most upvoted Data Engineer Things posts from May 2025, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/sources/detlife/best-of/2025/05#items","numberOfItems":3,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/airflow-3-and-airflow-ai-sdk-in-action-analyzing-league-of-legends-jlk5tztf9","name":"Airflow 3 and Airflow AI SDK in Action — Analyzing League of Legends"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/from-gis-to-data-engineering-mastering-docker-fundamentals-and-best-practices-arnrbop7i","name":"From GIS to Data Engineering: Mastering Docker Fundamentals and Best Practices"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/building-etl-pipeline-using-google-cloud-storage-7ynwfcqnh","name":"Building ETL pipeline using Google Cloud Storage"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Sources","item":"https://daily.dev/sources"},{"@type":"ListItem","position":3,"name":"Data Engineer Things","item":"https://daily.dev/sources/detlife"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/sources/detlife/best-of"},{"@type":"ListItem","position":5,"name":"May 2025"}]}]} ```