--- title: Data Sharing across Government Agencies using Delta Sharing description: A case study describes how the United States Citizenship and Immigration Services (USCIS) deployed Delta Sharing, an open protocol for secure data sharing, to... canonical: https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Data Sharing across Government Agencies using Delta Sharing | daily.dev og:description: A case study describes how the United States Citizenship and Immigration Services (USCIS) deployed Delta Sharing, an open protocol for secure data sharing, to... og:url: https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl og:image: https://api.daily.dev/og/posts/FgZt9WfJl.png og:image:alt: Data Sharing across Government Agencies using Delta Sharing og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Data Sharing across Government Agencies using Delta Sharing **[Delta Lake Blog](https://daily.dev/sources/delta-lake)** · 6 min read · 0 upvotes · 0 comments ## Summary A case study describes how the United States Citizenship and Immigration Services (USCIS) deployed Delta Sharing, an open protocol for secure data sharing, to enable inter-agency data exchange. The architecture uses a Delta Sharing server deployed on an EKS cluster, secured behind an Apigee envoy sidecar proxy for token management and JWT-based authentication. Access control is enforced through short-lived pre-signed S3 URLs, IAM roles assumed via Kubernetes service accounts (using Hadoop's WebIdentityTokenCredentialsProvider), and VPC-restricted bucket policies. API access is governed at the Apigee product level, allowing granular control over which developer apps can access which shared tables. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do you secure a Delta Sharing server deployment with IAM roles instead of hardcoded credentials? Configure the Sharing server to use Apache Hadoop's hadoop-aws module with the credential provider set to WebIdentityTokenCredentialsProvider in a core-site.xml file, then associate an IAM role with a Kubernetes service account so the server pod assumes that role at runtime. This avoids hardcoding any credentials or secrets in the deployment while still allowing the server to access underlying cloud storage like S3. _Teams securing data-sharing infrastructure can follow deployment patterns like this one on daily.dev._ ### How does Delta Sharing control access to shared data between organizations? Delta Sharing generates short-lived pre-signed S3 URLs for authenticated requests, which expire after a limited time so recipients must re-authenticate with a fresh JWT. An API gateway such as Apigee issues these JWTs, manages developer app registrations, and defines access granularity at the product level, while bucket policies can further restrict URL usage to specific VPCs. _Architects comparing secure data-sharing approaches can track patterns like this on daily.dev._ ## Similar posts on daily.dev - [Delta Sharing Top 10 Frequently Asked Questions, Answered - Part 1](https://daily.dev/posts/delta-sharing-top-10-frequently-asked-questions-answered---part-1-jdyjalzdq) · databricks · 0 upvotes · 0 comments - [Introducing OpenSharing: the Next Evolution of Delta Sharing for the Agentic Era](https://daily.dev/posts/introducing-opensharing-the-next-evolution-of-delta-sharing-for-the-agentic-era-lkofcqhbd) · databricks · 1 upvotes · 0 comments - [Databricks wants to kill the “email me a file” problem for AI agent skills](https://daily.dev/posts/databricks-wants-to-kill-the-email-me-a-file-problem-for-ai-agent-skills-lgaji9mzj) · The New Stack · 1 upvotes · 0 comments - [Databricks Announces OpenSharing, a Protocol for Sharing Data, AI Assets](https://daily.dev/posts/databricks-announces-opensharing-a-protocol-for-sharing-data-ai-assets-rtpw2umaz) · SD Times · 1 upvotes · 0 comments - [How Zalando Delivers Real-Time Insights to Its Partners Brands](https://daily.dev/posts/how-zalando-delivers-real-time-insights-to-its-partners-brands-ebzb67uuc) · ByteByteGo · 5 upvotes · 1 comments --- Tags: [#aws](https://daily.dev/tags/aws), [#kubernetes](https://daily.dev/tags/kubernetes), [#authentication](https://daily.dev/tags/authentication), [#data-engineering](https://daily.dev/tags/data-engineering) [View this post on daily.dev](https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Data Sharing across Government Agencies using Delta Sharing","url":"https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl"},"datePublished":"2026-08-16T08:53:42.499Z","dateModified":"2026-08-16T08:56:02.860Z","description":"A case study describes how the United States Citizenship and Immigration Services (USCIS) deployed Delta Sharing, an open protocol for secure data sharing, to...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/5cd548afc26984b5f4ffd752b84a995a?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/5cd548afc26984b5f4ffd752b84a995a?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Delta Lake Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Delta Lake Blog","logo":"https://media.daily.dev/image/upload/s--7f2q9Asf--/f_auto,q_auto/v1786870393/logos/delta-lake?_a=BAMAMicg0","url":"https://daily.dev/sources/delta-lake"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"aws,kubernetes,authentication,data-engineering","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Delta Lake Blog","item":"https://daily.dev/sources/delta-lake"},{"@type":"ListItem","position":3,"name":"Data Sharing across Government Agencies using Delta Sharing"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/data-sharing-across-government-agencies-using-delta-sharing-fgzt9wfjl#faq","mainEntity":[{"@type":"Question","name":"How do you secure a Delta Sharing server deployment with IAM roles instead of hardcoded credentials?","acceptedAnswer":{"@type":"Answer","text":"Configure the Sharing server to use Apache Hadoop's hadoop-aws module with the credential provider set to WebIdentityTokenCredentialsProvider in a core-site.xml file, then associate an IAM role with a Kubernetes service account so the server pod assumes that role at runtime. This avoids hardcoding any credentials or secrets in the deployment while still allowing the server to access underlying cloud storage like S3. Teams securing data-sharing infrastructure can follow deployment patterns like this one on daily.dev."}},{"@type":"Question","name":"How does Delta Sharing control access to shared data between organizations?","acceptedAnswer":{"@type":"Answer","text":"Delta Sharing generates short-lived pre-signed S3 URLs for authenticated requests, which expire after a limited time so recipients must re-authenticate with a fresh JWT. An API gateway such as Apigee issues these JWTs, manages developer app registrations, and defines access granularity at the product level, while bucket policies can further restrict URL usage to specific VPCs. Architects comparing secure data-sharing approaches can track patterns like this on daily.dev."}}]} ```