--- title: Apache Spark News & Updates | daily.dev description: Apache Spark news and updates covering a distributed engine for large-scale data processing. Readers can learn about the DataFrame and SQL APIs, execution planning and shuffles, structured streaming, tuning memory and partitions, running on Kubernetes or managed services, and lighter alternatives. canonical: https://daily.dev/tags/apache-spark twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/apache-spark og:type: website og:site_name: daily.dev og:title: Apache Spark News & Updates | daily.dev og:description: Apache Spark news and updates covering a distributed engine for large-scale data processing. Readers can learn about the DataFrame and SQL APIs, execution planning and shuffles, structured streaming, tuning memory and partitions, running on Kubernetes or managed services, and lighter alternatives. og:image: https://api.daily.dev/og/tags/apache-spark.png og:image:width: 1200 og:image:height: 630 --- ## Recommended Apache Spark stories ## Who to follow for Apache Spark [](https://daily.dev/joudawad) [Joud Awad](https://daily.dev/joudawad) [@joudawad](https://daily.dev/joudawad) Joined Mar 12\. 2026 81.9K  Metalab Verified Principal Solution Architecture ## Top sources covering Apache Spark ## Most upvoted Apache Spark posts ## Best discussed Apache Spark posts ## All posts about Apache Spark ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/apache-spark#page","url":"https://daily.dev/tags/apache-spark","name":"Apache Spark News & Updates","description":"Apache Spark news and updates covering a distributed engine for large-scale data processing. Readers can learn about the DataFrame and SQL APIs, execution planning and shuffles, structured streaming, tuning memory and partitions, running on Kubernetes or managed services, and lighter alternatives.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/apache-spark#items","numberOfItems":10,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/amazon-emr-7-1-now-supports-trino-435-python-3-11-skieasf27","name":"Amazon EMR 7.1 now supports Trino 435, Python 3.11"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/amazon-emr-serverless-announces-detailed-performance-monitoring-of-apache-spark-jobs-with-amazon-man-9ov5e4huj","name":"Amazon EMR Serverless announces detailed performance monitoring of Apache Spark jobs with Amazon Managed Service for Prometheus"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/unity-catalog-lakeguard-industry-first-and-only-data-governance-for-multi-user-apache-spark-cluste-8eaofxxjr","name":"Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apache™ Spark clusters"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/functional-elegance-making-spark-applications-cleaner-with-the-cats-library-0faexmwvl","name":"Functional Elegance: Making Spark Applications Cleaner with the Cats Library"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/how-data-cloud-processes-one-quadrillion-records-monthly-q4zjxd6py","name":"How Data Cloud Processes One Quadrillion Records Monthly"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/subqueries-and-ctes-in-spark-enhancing-data-analysis-and-manipulation-tl5dn6grk","name":"Subqueries and CTEs in Spark: Enhancing Data Analysis and Manipulation"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/introduction-to-apache-spark-part-2-r6tbpeu6j","name":"Introduction to Apache Spark | Part 2"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq","name":"What is Apache Spark? The big data platform that crushed Hadoop"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/upstage-ai-introduces-dataverse-for-addressing-challenges-in-data-processing-for-large-language-mode-5xsg3nzzl","name":"Upstage AI Introduces Dataverse for Addressing Challenges in Data Processing for Large Language Models"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/user-defined-aggregation-functions-in-spark-w9ogemgeh","name":"User-defined aggregation functions in Spark"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Apache Spark"}]}]} ```