--- title: Prompting Your Infrastructure: The Reality of LLMs in DevOps description: Argues that LLMs are only useful for DevOps and Kubernetes troubleshooting when given real operational context—CI/CD metadata, live metrics, and Kubernetes... canonical: https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Prompting Your Infrastructure: The Reality of LLMs in DevOps | daily.dev og:description: Argues that LLMs are only useful for DevOps and Kubernetes troubleshooting when given real operational context—CI/CD metadata, live metrics, and Kubernetes... og:url: https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9 og:image: https://api.daily.dev/og/posts/MlQo6RQF9.png og:image:alt: Prompting Your Infrastructure: The Reality of LLMs in DevOps og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Prompting Your Infrastructure: The Reality of LLMs in DevOps **[Devtron](https://daily.dev/sources/devtron)** · 7 min read · 1 upvotes · 0 comments ## Summary Argues that LLMs are only useful for DevOps and Kubernetes troubleshooting when given real operational context—CI/CD metadata, live metrics, and Kubernetes events—rather than acting as generic chatbots. Proposes a Human-in-the-loop (HITL) framework where AI proposes changes, policy-as-code tools like OPA or Kyverno validate them, and engineers give final approval before execution. Positions Devtron's platform as the governed, integrated layer that unifies these data sources so AI agents can move from reactive troubleshooting to predictive operations, such as flagging memory leak trends before they cause outages. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [How LLMs and AI agents eliminate DevOps toil with intelligent automation](https://daily.dev/posts/how-llms-and-ai-agents-eliminate-devops-toil-with-intelligent-automation-guxyba1iv) · All Things Open · 1 upvotes · 0 comments - [LLMOps and platform engineering: Who should own the AI pipeline?](https://daily.dev/posts/llmops-and-platform-engineering-who-should-own-the-ai-pipeline--rv51jpbxm) · CNCF · 0 upvotes · 0 comments - [DevOps Is Still Waiting for Its Cursor Moment](https://daily.dev/posts/devops-is-still-waiting-for-its-cursor-moment-j5yqigv2d) · The New Stack · 0 upvotes · 0 comments - [You don’t need AI for everything: A reality check for developers](https://daily.dev/posts/you-don-t-need-ai-for-everything-a-reality-check-for-developers-dkn1lmxpu) · LogRocket · 2 upvotes · 0 comments - [AI Agents in DevOps: Hype vs. Reality in Production Pipelines](https://daily.dev/posts/ai-agents-in-devops-hype-vs-reality-in-production-pipelines-zp70wtm0z) · DevOps.com · 1 upvotes · 0 comments --- Tags: [#llm](https://daily.dev/tags/llm), [#kubernetes](https://daily.dev/tags/kubernetes), [#gitops](https://daily.dev/tags/gitops), [#policy-as-code](https://daily.dev/tags/policy-as-code), [#devtron](https://daily.dev/tags/devtron) [View this post on daily.dev](https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Prompting Your Infrastructure: The Reality of LLMs in DevOps","url":"https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9"},"datePublished":"2026-08-19T13:59:00.232Z","dateModified":"2026-09-13T20:21:51.867Z","description":"Argues that LLMs are only useful for DevOps and Kubernetes troubleshooting when given real operational context—CI/CD metadata, live metrics, and Kubernetes...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/cf6eca377a66c0ccf4a58654193491ad?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/cf6eca377a66c0ccf4a58654193491ad?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Devtron","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Devtron","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/b077f74bd1d349db886224d64d521942","url":"https://daily.dev/sources/devtron"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/prompting-your-infrastructure-the-reality-of-llms-in-devops-mlqo6rqf9","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"llm,kubernetes,gitops,policy-as-code,devtron","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Devtron","item":"https://daily.dev/sources/devtron"},{"@type":"ListItem","position":3,"name":"Prompting Your Infrastructure: The Reality of LLMs in DevOps"}]} ```