--- title: LLM Key Server: Providing Secure and Convenient Access... description: Mercari's AI Security team built an LLM Key Server to provide secure access to internal LLM APIs using temporary credentials instead of static API keys. The... canonical: https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: LLM Key Server: Providing Secure and Convenient Access to Internal LLM APIs | daily.dev og:description: Mercari's AI Security team built an LLM Key Server to provide secure access to internal LLM APIs using temporary credentials instead of static API keys. The... og:url: https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl og:image: https://api.daily.dev/og/posts/bjURovfBL.png og:image:alt: LLM Key Server: Providing Secure and Convenient Access to Internal LLM APIs og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # LLM Key Server: Providing Secure and Convenient Access to Internal LLM APIs **[Mercari Engineering](https://daily.dev/sources/mercari)** · 7 min read · 2 upvotes · 0 comments ## Summary Mercari's AI Security team built an LLM Key Server to provide secure access to internal LLM APIs using temporary credentials instead of static API keys. The system leverages LiteLLM for unified API access and Google's OIDC ID tokens for authentication, issuing short-lived keys that automatically renew. It supports multiple environments including local development, GitHub Actions, and Google Apps Script through common templates, eliminating manual key management while reducing security risks from leaked credentials. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [LiteLLM: AI Gateway for LLMs — Features Overview](https://daily.dev/posts/litellm-ai-gateway-for-llms-features-overview-93hxfkgaq) · ITNEXT · 0 upvotes · 0 comments - [LLM Heist: Hijacking LiteLLM for Traffic Interception, Key Theft, and Tool-Call Injection · Embrace The Red](https://daily.dev/posts/llm-heist-hijacking-litellm-for-traffic-interception-key-theft-and-tool-call-injection-embrace--li9gykium) · Embrace The Red · 0 upvotes · 0 comments - [LLMs on Kubernetes: Same Cluster, Different Threat Model](https://daily.dev/posts/llms-on-kubernetes-same-cluster-different-threat-model-pwv5wm3sx) · MetalBear · 1 upvotes · 0 comments - [Secure Third-Party Tool Calling in LlamaIndex Using Auth0](https://daily.dev/posts/secure-third-party-tool-calling-in-llamaindex-using-auth0-mipiryz3l) · Auth0 · 1 upvotes · 0 comments --- Tags: [#security](https://daily.dev/tags/security), [#llm](https://daily.dev/tags/llm), [#authentication](https://daily.dev/tags/authentication), [#gcp](https://daily.dev/tags/gcp) [View this post on daily.dev](https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"LLM Key Server: Providing Secure and Convenient Access to Internal LLM APIs","url":"https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl"},"datePublished":"2025-12-02T02:05:16.499Z","dateModified":"2025-12-02T02:05:45.083Z","description":"Mercari's AI Security team built an LLM Key Server to provide secure access to internal LLM APIs using temporary credentials instead of static API keys. The...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/af04efe84a1526e66a9d17c6634c324d?_a=AQAEulh","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/af04efe84a1526e66a9d17c6634c324d?_a=AQAEulh","isAccessibleForFree":true,"articleSection":"Mercari Engineering","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Mercari Engineering","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/cdde515cd83640748689d74c2d938fcf","url":"https://daily.dev/sources/mercari"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/llm-key-server-providing-secure-and-convenient-access-to-internal-llm-apis-bjurovfbl","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"security,llm,authentication,gcp","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Mercari Engineering","item":"https://daily.dev/sources/mercari"},{"@type":"ListItem","position":3,"name":"LLM Key Server: Providing Secure and Convenient Access to Internal LLM APIs"}]} ```