--- title: Using Delta Lake with AWS Glue | daily.dev description: A walkthrough shows how to register Delta Lake tables in the AWS Glue Data Catalog using the Glue Crawler, then query them with Amazon Athena, Redshift, and... canonical: https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Using Delta Lake with AWS Glue | daily.dev og:description: A walkthrough shows how to register Delta Lake tables in the AWS Glue Data Catalog using the Glue Crawler, then query them with Amazon Athena, Redshift, and... og:url: https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk og:image: https://api.daily.dev/og/posts/zWTWsiKVK.png og:image:alt: Using Delta Lake with AWS Glue og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Using Delta Lake with AWS Glue **[Delta Lake Blog](https://daily.dev/sources/delta-lake)** · 4 min read · 0 upvotes · 0 comments ## Summary A walkthrough shows how to register Delta Lake tables in the AWS Glue Data Catalog using the Glue Crawler, then query them with Amazon Athena, Redshift, and EMR. It covers creating Delta tables in S3 with PySpark, registering them via the crawler, and the benefits of centralized cataloging such as permission management and cross-team access without needing to track table storage paths. It also demonstrates registering the same Delta table in both AWS Glue Data Catalog and Unity Catalog, useful when different engines or catalog-specific features are needed, and notes the importance of concurrency control when multiple engines write to the same table. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do I query a Delta Lake table stored in S3 using Amazon Athena? Register the Delta table in the AWS Glue Data Catalog first, then query it directly from Athena by table name. Use an AWS Glue Crawler configured for Delta Lake to scan the S3 location and add the table's metadata to the Glue Data Catalog, after which Athena, Redshift, and EMR can all reference it without needing to know the underlying S3 path. _daily.dev surfaces practical guides like this for engineers wiring up Delta Lake with AWS query engines._ ### Can a Delta Lake table be registered in both Unity Catalog and AWS Glue Data Catalog at the same time? Yes, a Delta table can be registered in multiple catalogs simultaneously, such as Unity Catalog and AWS Glue Data Catalog. This is useful when a table is updated via a Spark-based ETL process tracked in Unity Catalog but also needs to be queryable through AWS Athena via Glue. Rerunning the Glue Delta crawler keeps the Glue-registered version in sync after new data is appended. _Data engineers comparing catalog strategies can track patterns like this on daily.dev._ ### What should I watch out for when multiple engines write to the same Delta Lake table? Concurrency control becomes critical when multiple engines or catalogs interact with the same Delta table, since simultaneous writes from different execution environments can conflict. Delta Lake provides concurrency control mechanisms to handle this, which matter especially when a table is registered across multiple catalogs like Glue and Unity Catalog and accessed by different tools. _daily.dev helps engineers stay ahead of concurrency pitfalls when scaling multi-engine data pipelines._ ## Similar posts on daily.dev - [Apache Iceberg on AWS: Glue Catalog, Athena, EMR, and S3 Tables](https://daily.dev/posts/apache-iceberg-on-aws-glue-catalog-athena-emr-and-s3-tables-qgxux89im) · BigData Boutique blog · 0 upvotes · 0 comments - [Bootstrap a Data Lakehouse in an Afternoon](https://daily.dev/posts/bootstrap-a-data-lakehouse-in-an-afternoon-co4kw9dyi) · Towards Data Science · 0 upvotes · 0 comments - [If it’s in your catalog, you can query it: The DataLakeCatalog engine in ClickHouse Cloud](https://daily.dev/posts/if-it-s-in-your-catalog-you-can-query-it-the-datalakecatalog-engine-in-clickhouse-cloud-sqo65sxpy) · ClickHouse · 0 upvotes · 0 comments - [Are you using Databricks and want to try the power of Snowflake?](https://daily.dev/posts/are-you-using-databricks-and-want-to-try-the-power-of-snowflake--sm1ypskf0) · Snowflake Community · 0 upvotes · 0 comments - [Simplified permissions for Amazon S3 Tables and Iceberg materialized views are now available in AWS GovCloud \(US\) Regions](https://daily.dev/posts/simplified-permissions-for-amazon-s3-tables-and-iceberg-materialized-views-are-now-available-in-aws--me0dinp3d) · AWS · 0 upvotes · 0 comments --- Tags: [#aws](https://daily.dev/tags/aws), [#data-engineering](https://daily.dev/tags/data-engineering), [#unity-catalog](https://daily.dev/tags/unity-catalog) [View this post on daily.dev](https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Using Delta Lake with AWS Glue","url":"https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk"},"datePublished":"2026-08-16T08:53:29.430Z","dateModified":"2026-08-16T08:55:50.785Z","description":"A walkthrough shows how to register Delta Lake tables in the AWS Glue Data Catalog using the Glue Crawler, then query them with Amazon Athena, Redshift, and...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/8a5af986d3d18adfcc2cacd2d715f16a?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/8a5af986d3d18adfcc2cacd2d715f16a?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Delta Lake Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Delta Lake Blog","logo":"https://media.daily.dev/image/upload/s--7f2q9Asf--/f_auto,q_auto/v1786870393/logos/delta-lake?_a=BAMAMicg0","url":"https://daily.dev/sources/delta-lake"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"aws,data-engineering,unity-catalog","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Delta Lake Blog","item":"https://daily.dev/sources/delta-lake"},{"@type":"ListItem","position":3,"name":"Using Delta Lake with AWS Glue"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/using-delta-lake-with-aws-glue-zwtwsikvk#faq","mainEntity":[{"@type":"Question","name":"How do I query a Delta Lake table stored in S3 using Amazon Athena?","acceptedAnswer":{"@type":"Answer","text":"Register the Delta table in the AWS Glue Data Catalog first, then query it directly from Athena by table name. Use an AWS Glue Crawler configured for Delta Lake to scan the S3 location and add the table's metadata to the Glue Data Catalog, after which Athena, Redshift, and EMR can all reference it without needing to know the underlying S3 path. daily.dev surfaces practical guides like this for engineers wiring up Delta Lake with AWS query engines."}},{"@type":"Question","name":"Can a Delta Lake table be registered in both Unity Catalog and AWS Glue Data Catalog at the same time?","acceptedAnswer":{"@type":"Answer","text":"Yes, a Delta table can be registered in multiple catalogs simultaneously, such as Unity Catalog and AWS Glue Data Catalog. This is useful when a table is updated via a Spark-based ETL process tracked in Unity Catalog but also needs to be queryable through AWS Athena via Glue. Rerunning the Glue Delta crawler keeps the Glue-registered version in sync after new data is appended. Data engineers comparing catalog strategies can track patterns like this on daily.dev."}},{"@type":"Question","name":"What should I watch out for when multiple engines write to the same Delta Lake table?","acceptedAnswer":{"@type":"Answer","text":"Concurrency control becomes critical when multiple engines or catalogs interact with the same Delta table, since simultaneous writes from different execution environments can conflict. Delta Lake provides concurrency control mechanisms to handle this, which matter especially when a table is registered across multiple catalogs like Glue and Unity Catalog and accessed by different tools. daily.dev helps engineers stay ahead of concurrency pitfalls when scaling multi-engine data pipelines."}}]} ```