--- title: Best Towards Dev posts — November 2024 | daily.dev description: The most upvoted Towards Dev posts from November 2024, curated by the daily.dev community. canonical: https://daily.dev/sources/towardsdev/best-of/2024/11 twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/sources/towardsdev/best-of/2024/11 og:type: website og:site_name: daily.dev og:title: Best Towards Dev posts — November 2024 | daily.dev og:description: The most upvoted Towards Dev posts from November 2024, curated by the daily.dev community. og:image: https://media.daily.dev/image/upload/s--VAY5ToZt--/f_auto/v1724209435/public/daily.dev%20-%20open%20graph --- # Best of Towards Dev — November 2024 1. 1 [](https://daily.dev/posts/data-driven-football-insights-from-web-scraping-to-visualization-using-airflow-dbt-cloud-and-aws-nbt95tkr2 "“Data-Driven Football Insights: From Web Scraping to Visualization Using Airflow, Dbt Cloud, and AWS Tech Stack”") Article Towards Dev · 2y “Data-Driven Football Insights: From Web Scraping to Visualization Using Airflow, Dbt Cloud, and AWS Tech Stack” This project automates the process of collecting, storing, and analyzing football data using technologies like Apache Airflow, DBT Cloud, and AWS. The workflow includes web scraping data using Python, storing it in Amazon S3, processing it in Amazon Redshift, transforming data with DBT Cloud, and visualizing it through Amazon QuickSight. This integrated approach offers a scalable solution to manage and analyze detailed football statistics efficiently. 24 [See all Towards Dev archives](/sources/towardsdev/best-of) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/sources/towardsdev/best-of/2024/11#page","url":"https://daily.dev/sources/towardsdev/best-of/2024/11","name":"Best Towards Dev Posts — November 2024","description":"The most upvoted Towards Dev posts from November 2024, curated by the daily.dev community.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/sources/towardsdev/best-of/2024/11#items","numberOfItems":1,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/data-driven-football-insights-from-web-scraping-to-visualization-using-airflow-dbt-cloud-and-aws-nbt95tkr2","name":"“Data-Driven Football Insights: From Web Scraping to Visualization Using Airflow, Dbt Cloud, and AWS Tech Stack”"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Sources","item":"https://daily.dev/sources"},{"@type":"ListItem","position":3,"name":"Towards Dev","item":"https://daily.dev/sources/towardsdev"},{"@type":"ListItem","position":4,"name":"Best of","item":"https://daily.dev/sources/towardsdev/best-of"},{"@type":"ListItem","position":5,"name":"November 2024"}]}]} ```