--- title: LangSmith LLM Gateway: runtime governance built into the... description: LangChain is launching LangSmith LLM Gateway, a runtime governance layer that sits between AI agents and LLM providers. It enforces spend limits at... canonical: https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: LangSmith LLM Gateway: runtime governance built into the agent lifecycle | daily.dev og:description: LangChain is launching LangSmith LLM Gateway, a runtime governance layer that sits between AI agents and LLM providers. It enforces spend limits at... og:url: https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv og:image: https://api.daily.dev/og/posts/rgiMgpAPV.png og:image:alt: LangSmith LLM Gateway: runtime governance built into the agent lifecycle og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # LangSmith LLM Gateway: runtime governance built into the agent lifecycle **[LangChain](https://daily.dev/sources/langchain)** · 6 min read · 1 upvotes · 0 comments ## Summary LangChain is launching LangSmith LLM Gateway, a runtime governance layer that sits between AI agents and LLM providers. It enforces spend limits at org/workspace/user/API key levels, redacts PII and secrets before requests reach the model, and surfaces policy violations as traceable events directly inside LangSmith. Setup requires only a base_url swap. The gateway eliminates the need to stitch together separate guardrails platforms, audit pipelines, and observability stacks. Future plans include tool call governance, MCP server controls, model fallbacks, and deeper security controls. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is LangSmith LLM Gateway and what does it do? LangSmith LLM Gateway is a runtime governance layer that sits between agents and LLM providers, enforcing spend limits and redacting PII or secrets before requests reach the model. Policy violations appear as traceable events directly in LangSmith, letting teams trace a blocked request back to its cause without separate dashboards or audit tools. It entered public beta on July 30, 2026. _Teams weighing agent governance options can track releases like this one on daily.dev._ ### How do I set up LangSmith LLM Gateway for my agents? Setup only requires pointing agents at the LangSmith Gateway endpoint using your LangSmith API key, adding provider API keys to workspace secrets, and configuring policies in the LangSmith UI. No separate infrastructure is needed, and existing agent code stays unchanged aside from swapping the base_url value. _Developers integrating governance into existing agent code can follow launch details like this via daily.dev._ ### What happens when an agent hits a spend limit set in LangSmith LLM Gateway? The agent receives a 402 response with a clear error when a configured spend cap is hit. Caps can be set at the organization, workspace, user, or API key level, and real-time cost rollups by workspace, user, and API key give visibility to avoid surprise invoices. _Anyone budgeting for production LLM spend can follow rollouts like this through daily.dev._ ## Similar posts on daily.dev - [Building Governed Agents: A Framework for Cost, Control, and Compliance](https://daily.dev/posts/building-governed-agents-a-framework-for-cost-control-and-compliance-tx56i9t9r) · LangChain · 4 upvotes · 1 comments - [AI Agent governance](https://daily.dev/posts/ai-agent-governance-vb0etdbdu) · portkey · 1 upvotes · 0 comments - [LangSmith Cost Tracking: Full Guide to Logging, Monitoring, and Optimizing LLM Costs](https://daily.dev/posts/langsmith-cost-tracking-full-guide-to-logging-monitoring-and-optimizing-llm-costs-8wv6vi2v9) · C\# Corner · 1 upvotes · 0 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#langchain](https://daily.dev/tags/langchain), [#langsmith](https://daily.dev/tags/langsmith) [View this post on daily.dev](https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"LangSmith LLM Gateway: runtime governance built into the agent lifecycle","url":"https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv"},"datePublished":"2026-07-30T17:42:11.365Z","dateModified":"2026-09-13T19:54:42.963Z","description":"LangChain is launching LangSmith LLM Gateway, a runtime governance layer that sits between AI agents and LLM providers. It enforces spend limits at...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/c33b39402425bd7da03e18177e227e21?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/c33b39402425bd7da03e18177e227e21?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"LangChain","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"LangChain","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/0f4f2629e0724a849823f8cd0d913e13","url":"https://daily.dev/sources/langchain"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai-agents,langchain,langsmith","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"LangChain","item":"https://daily.dev/sources/langchain"},{"@type":"ListItem","position":3,"name":"LangSmith LLM Gateway: runtime governance built into the agent lifecycle"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/langsmith-llm-gateway-runtime-governance-built-into-the-agent-lifecycle-rgimgpapv#faq","mainEntity":[{"@type":"Question","name":"What is LangSmith LLM Gateway and what does it do?","acceptedAnswer":{"@type":"Answer","text":"LangSmith LLM Gateway is a runtime governance layer that sits between agents and LLM providers, enforcing spend limits and redacting PII or secrets before requests reach the model. Policy violations appear as traceable events directly in LangSmith, letting teams trace a blocked request back to its cause without separate dashboards or audit tools. It entered public beta on July 30, 2026. Teams weighing agent governance options can track releases like this one on daily.dev."}},{"@type":"Question","name":"How do I set up LangSmith LLM Gateway for my agents?","acceptedAnswer":{"@type":"Answer","text":"Setup only requires pointing agents at the LangSmith Gateway endpoint using your LangSmith API key, adding provider API keys to workspace secrets, and configuring policies in the LangSmith UI. No separate infrastructure is needed, and existing agent code stays unchanged aside from swapping the base_url value. Developers integrating governance into existing agent code can follow launch details like this via daily.dev."}},{"@type":"Question","name":"What happens when an agent hits a spend limit set in LangSmith LLM Gateway?","acceptedAnswer":{"@type":"Answer","text":"The agent receives a 402 response with a clear error when a configured spend cap is hit. Caps can be set at the organization, workspace, user, or API key level, and real-time cost rollups by workspace, user, and API key give visibility to avoid surprise invoices. Anyone budgeting for production LLM spend can follow rollouts like this through daily.dev."}}]} ```