--- title: Trace Kubernetes resources for llm-d model serving description: A walkthrough of Kubernetes resources created when deploying LLM inference workloads using Red Hat AI Inference on Amazon EKS. Covers two deployment scenarios:... canonical: https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Trace Kubernetes resources for llm-d model serving | daily.dev og:description: A walkthrough of Kubernetes resources created when deploying LLM inference workloads using Red Hat AI Inference on Amazon EKS. Covers two deployment scenarios:... og:url: https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb og:image: https://api.daily.dev/og/posts/Avx1YOEgb.png og:image:alt: Trace Kubernetes resources for llm-d model serving og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Trace Kubernetes resources for llm-d model serving **[Red Hat Developer](https://daily.dev/sources/rhdev)** · 8 min read · 0 upvotes · 0 comments ## Summary A walkthrough of Kubernetes resources created when deploying LLM inference workloads using Red Hat AI Inference on Amazon EKS. Covers two deployment scenarios: a basic LLMInferenceService without routing and one with the llm-d router block enabled. Uses kubectl tree to trace all generated resources including Deployments, ReplicaSets, Services, EndpointSlices, InferencePool, HTTPRoute, and DestinationRules. Explains how the scheduler, route, and gateway subfields in the router configuration map to specific Kubernetes objects, and how intelligent routing based on queue depth and cache locality differs from simple round-robin load balancing. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [How llm-d routes model inference traffic on Amazon EKS](https://daily.dev/posts/how-llm-d-routes-model-inference-traffic-on-amazon-eks-tlb0xiou0) · Red Hat Developer · 0 upvotes · 0 comments - [Monitor LLM routing with the Kubernetes Inference Extension](https://daily.dev/posts/monitor-llm-routing-with-the-kubernetes-inference-extension-2xwttjkou) · Datadog · 0 upvotes · 0 comments - [Running LLM Inference on Kubernetes: What It Actually Takes](https://daily.dev/posts/running-llm-inference-on-kubernetes-what-it-actually-takes-opl6iozrg) · Fairwinds Blog · 0 upvotes · 0 comments - [Intelligent inference scheduling with llm-d on Red Hat AI](https://daily.dev/posts/intelligent-inference-scheduling-with-llm-d-on-red-hat-ai-q8lqp3mss) · Red Hat Developer · 0 upvotes · 0 comments - [How to Diagnose and Fix AI Inference Latency on Kubernetes](https://daily.dev/posts/how-to-diagnose-and-fix-ai-inference-latency-on-kubernetes-flymwvtow) · freeCodeCamp · 1 upvotes · 0 comments --- Tags: [#kubernetes](https://daily.dev/tags/kubernetes), [#ai-inference](https://daily.dev/tags/ai-inference), [#vllm](https://daily.dev/tags/vllm) [View this post on daily.dev](https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Trace Kubernetes resources for llm-d model serving","url":"https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb"},"datePublished":"2026-08-05T07:22:12.101Z","dateModified":"2026-08-05T07:22:33.742Z","description":"A walkthrough of Kubernetes resources created when deploying LLM inference workloads using Red Hat AI Inference on Amazon EKS. Covers two deployment scenarios:...","image":"https://media.daily.dev/image/upload/s--P4t4XyoV--/f_auto/v1722860399/public/Placeholder%2001","thumbnailUrl":"https://media.daily.dev/image/upload/s--P4t4XyoV--/f_auto/v1722860399/public/Placeholder%2001","isAccessibleForFree":true,"articleSection":"Red Hat Developer","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Red Hat Developer","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/2a8895f3216c4900bdc455585a4ad3e4","url":"https://daily.dev/sources/rhdev"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/trace-kubernetes-resources-for-llm-d-model-serving-avx1yoegb","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"kubernetes,ai-inference,vllm","timeRequired":"PT8M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Red Hat Developer","item":"https://daily.dev/sources/rhdev"},{"@type":"ListItem","position":3,"name":"Trace Kubernetes resources for llm-d model serving"}]} ```