--- title: What is Apache Spark? The big data platform that crushed... description: Apache Spark is a powerful data processing framework for big data and machine learning. It offers key features such as distributed computing, Spark RDD, Spark... canonical: https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: What is Apache Spark? The big data platform that crushed Hadoop | daily.dev og:description: Apache Spark is a powerful data processing framework for big data and machine learning. It offers key features such as distributed computing, Spark RDD, Spark... og:url: https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq og:image: https://api.daily.dev/og/posts/fpVorPoaQ.png og:image:alt: What is Apache Spark? The big data platform that crushed Hadoop og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # What is Apache Spark? The big data platform that crushed Hadoop **[InfoWorld](https://daily.dev/sources/infoworld)** · 9 min read · 3 upvotes · 0 comments ## Summary Apache Spark is a powerful data processing framework for big data and machine learning. It offers key features such as distributed computing, Spark RDD, Spark SQL, Spark MLlib, Structured Streaming, Delta Lake, and Pandas API integration. Users can run Apache Spark in standalone mode or on platforms like Hadoop YARN or Kubernetes. The Databricks Lakehouse Platform is a popular managed solution for interacting with Apache Spark. Resources like tutorials, books, and learning portals are available to learn Apache Spark. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#apache-spark](https://daily.dev/tags/apache-spark), [#big-data](https://daily.dev/tags/big-data), [#data-analysis](https://daily.dev/tags/data-analysis), [#data-processing](https://daily.dev/tags/data-processing), [#distributed-systems](https://daily.dev/tags/distributed-systems) [View this post on daily.dev](https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"What is Apache Spark? The big data platform that crushed Hadoop","url":"https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq"},"datePublished":"2024-04-03T09:05:15.700Z","dateModified":"2024-11-16T02:16:35.623Z","description":"Apache Spark is a powerful data processing framework for big data and machine learning. It offers key features such as distributed computing, Spark RDD, Spark...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/35a2539f95b59484e2cb451a4f2cbc92?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/35a2539f95b59484e2cb451a4f2cbc92?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"InfoWorld","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"InfoWorld","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/bf6d68a999064029b0bb09aa6268f1f3","url":"https://daily.dev/sources/infoworld"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/what-is-apache-spark-the-big-data-platform-that-crushed-hadoop-fpvorpoaq","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":3},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"apache-spark,big-data,data-analysis,data-processing,distributed-systems","timeRequired":"PT9M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"InfoWorld","item":"https://daily.dev/sources/infoworld"},{"@type":"ListItem","position":3,"name":"What is Apache Spark? The big data platform that crushed Hadoop"}]} ```