--- title: Amazon EMR on EKS now supports Apache Spark... description: Amazon EMR on EKS now includes an Apache Spark troubleshooting agent that lets data engineers diagnose job failures using natural language. The agent analyzes... canonical: https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Amazon EMR on EKS now supports Apache Spark troubleshooting agent | daily.dev og:description: Amazon EMR on EKS now includes an Apache Spark troubleshooting agent that lets data engineers diagnose job failures using natural language. The agent analyzes... og:url: https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx og:image: https://api.daily.dev/og/posts/bwnMiLBVX.png og:image:alt: Amazon EMR on EKS now supports Apache Spark troubleshooting agent og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Amazon EMR on EKS now supports Apache Spark troubleshooting agent **[AWS](https://daily.dev/sources/aws)** · 2 min read · 2 upvotes · 0 comments ## Summary Amazon EMR on EKS now includes an Apache Spark troubleshooting agent that lets data engineers diagnose job failures using natural language. The agent analyzes Spark History Server data, executor logs, and cluster configurations to identify issues like memory errors, data skew, resource contention, and connectivity failures, then provides automated root cause analysis and PySpark code recommendations. This extends the agent's coverage to all EMR deployment options (EC2, Serverless, and EKS). It is accessible via the EMR on EKS console's 'Troubleshoot with AI' button or through MCP-compatible AI coding agents such as Kiro, Claude Code, and Cursor. All operations are read-only, IAM-authenticated, and logged in AWS CloudTrail. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Apache Spark troubleshooting and upgrade agents now available as Kiro powers](https://daily.dev/posts/apache-spark-troubleshooting-and-upgrade-agents-now-available-as-kiro-powers-rwa2zodah) · AWS · 0 upvotes · 0 comments - [Announcing the Apache Spark upgrade agent for Amazon EMR](https://daily.dev/posts/announcing-the-apache-spark-upgrade-agent-for-amazon-emr-2jsooflao) · AWS · 0 upvotes · 0 comments - [EverC: Regaining Control of Data Platform Costs on AWS with EMR on EKS](https://daily.dev/posts/everc-regaining-control-of-data-platform-costs-on-aws-with-emr-on-eks-x1fldlsgc) · BigData Boutique blog · 1 upvotes · 0 comments - [Run interactive workloads on Amazon EMR on EC2 with Spark Connect](https://daily.dev/posts/run-interactive-workloads-on-amazon-emr-on-ec2-with-spark-connect-6faagxn6k) · AWS · 0 upvotes · 0 comments - [Self-Healing Kubernetes Gets Real — and Risky: Running AI Agents on Amazon EKS](https://daily.dev/posts/self-healing-kubernetes-gets-real-and-risky-running-ai-agents-on-amazon-eks-0cqww64he) · Cloud Native Now · 0 upvotes · 0 comments --- Tags: [#aws](https://daily.dev/tags/aws), [#kubernetes](https://daily.dev/tags/kubernetes), [#ai-agents](https://daily.dev/tags/ai-agents), [#mcp](https://daily.dev/tags/mcp), [#apache-spark](https://daily.dev/tags/apache-spark) [View this post on daily.dev](https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Amazon EMR on EKS now supports Apache Spark troubleshooting agent","url":"https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx"},"datePublished":"2026-07-10T19:06:42.778Z","dateModified":"2026-09-14T06:12:54.332Z","description":"Amazon EMR on EKS now includes an Apache Spark troubleshooting agent that lets data engineers diagnose job failures using natural language. The agent analyzes...","image":"https://media.daily.dev/image/upload/s--1KxV4ohY--/f_auto/v1722860400/public/Placeholder%2007","thumbnailUrl":"https://media.daily.dev/image/upload/s--1KxV4ohY--/f_auto/v1722860400/public/Placeholder%2007","isAccessibleForFree":true,"articleSection":"AWS","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"AWS","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/aws","url":"https://daily.dev/sources/aws"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/amazon-emr-on-eks-now-supports-apache-spark-troubleshooting-agent-bwnmilbvx","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"aws,kubernetes,ai-agents,mcp,apache-spark","timeRequired":"PT2M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"AWS","item":"https://daily.dev/sources/aws"},{"@type":"ListItem","position":3,"name":"Amazon EMR on EKS now supports Apache Spark troubleshooting agent"}]} ```