--- title: GitHub - NVIDIA-NeMo/Switchyard | daily.dev description: Switchyard is a pre-alpha Rust proxy and library from NVIDIA NeMo for routing LLM traffic across multiple providers. It translates between OpenAI Chat,... canonical: https://daily.dev/posts/slm1ibtau twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: GitHub - NVIDIA-NeMo/Switchyard | daily.dev og:description: Switchyard is a pre-alpha Rust proxy and library from NVIDIA NeMo for routing LLM traffic across multiple providers. It translates between OpenAI Chat,... og:url: https://daily.dev/posts/slm1ibtau og:image: https://api.daily.dev/og/posts/slM1iBtAU.png og:image:alt: Post cover image og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # GitHub - NVIDIA-NeMo/Switchyard **[The Dump](https://daily.dev/sources/thedump)** · [@denisb0](https://daily.dev/denisb0) · 1 upvotes · 0 comments ## Summary Switchyard is a pre-alpha Rust proxy and library from NVIDIA NeMo for routing LLM traffic across multiple providers. It translates between OpenAI Chat, Anthropic Messages, and OpenAI Responses API formats, enabling coding agents like Claude Code or Codex to target open-source models (vLLM, NVIDIA NIM, Ollama) without changing their native API calls. It supports multiple routing strategies including LLM-as-classifier, signal-driven stage routing, escalation routing, and random A/B split routing. Prometheus metrics cover requests, errors, latency, tokens, and routing overhead. It can be used as a standalone server, a launcher for coding agents, or embedded as a Rust library. Currently experimental and not recommended for production use. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments - [CNCF Unveils Schedule for KubeCon \+ CloudNativeCon Europe 2026](https://daily.dev/posts/cncf-unveils-schedule-for-kubecon-cloudnativecon-europe-2026-ikhcoa5cb) · CNCF · 2 upvotes · 0 comments - [CNCF Debuts KubeCon \+ CloudNativeCon Japan 2026 Schedule](https://daily.dev/posts/cncf-debuts-kubecon-cloudnativecon-japan-2026-schedule-xp5pyudub) · CNCF · 1 upvotes · 0 comments --- Tags: [#rust](https://daily.dev/tags/rust), [#openai](https://daily.dev/tags/openai), [#nvidia](https://daily.dev/tags/nvidia) [View this post on daily.dev](https://daily.dev/posts/slm1ibtau) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"DiscussionForumPosting","mainEntityOfPage":"https://daily.dev/posts/slm1ibtau","headline":"GitHub - NVIDIA-NeMo/Switchyard","text":"Shared: GitHub - NVIDIA-NeMo/Switchyard","url":"https://daily.dev/posts/slm1ibtau","datePublished":"2026-08-11T13:36:19.175Z","dateModified":"2026-08-11T13:37:33.773Z","author":{"@type":"Person","name":"Denis Bolkovskis","url":"https://daily.dev/denisb0","image":"https://media.daily.dev/image/upload/s--PGCuYx85--/f_auto,q_auto/v1/avatars/avatar_yRuVFf6IbfTylBjx9Dzvt","description":"resident meme expert","interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"EndorseAction"},"userInteractionCount":56590}},"image":"https://media.daily.dev/image/upload/s--0_ODbtD2--/f_auto/v1722860399/public/Placeholder%2008","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"sharedContent":{"@type":"WebPage","url":"https://api.daily.dev/r/bIIsW29W9"},"isPartOf":{"@type":"WebPage","url":"https://daily.dev/squads/thedump","name":"The Dump"}} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"The Dump","item":"https://daily.dev/squads/thedump"},{"@type":"ListItem","position":3,"name":"GitHub - NVIDIA-NeMo/Switchyard"}]} ```