Discover more about what's new at AWS with AWS Glue Interactive Sessions now support Spark Connect for interactive workloads

AWS' platform is a leading cloud computing platform, offering insights into cloud infrastructure, services, and solutions for developers, businesses, and IT professionals. Through articles, whitepapers, and documentation, AWS offers insights into cloud architecture, serverless computing, and machine learning on AWS. Developers and architects can learn about AWS services like EC2, S3, Lambda, and more to build scalable, secure, and cost-effective cloud applications.

AWS Glue Interactive Sessions now support Apache Spark Connect, enabling developers to run Spark applications from local environments like Jupyter, VS Code, or Amazon SageMaker Unified Studio notebooks against AWS Glue's serverless infrastructure. The thin client architecture decouples the client from the Spark execution environment, supporting ad hoc data exploration, iterative debugging, and incremental PySpark development. It also provides real-time monitoring via Spark UI, history tracking, and session management through the AWS Glue API, CLI, or SDK. The feature is available across multiple AWS regions.