--- title: Optimize AI costs with Agent Observability | daily.dev description: Datadog's Agent Observability ties AI spend to the applications and traces that generate it, instead of just API keys and models. The Cost page breaks down... canonical: https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Optimize AI costs with Agent Observability | daily.dev og:description: Datadog's Agent Observability ties AI spend to the applications and traces that generate it, instead of just API keys and models. The Cost page breaks down... og:url: https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu og:image: https://api.daily.dev/og/posts/LnsOUoALU.png og:image:alt: Optimize AI costs with Agent Observability og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Optimize AI costs with Agent Observability **[Datadog](https://daily.dev/sources/datadog)** · 9 min read · 0 upvotes · 0 comments ## Summary Datadog's Agent Observability ties AI spend to the applications and traces that generate it, instead of just API keys and models. The Cost page breaks down total spend by application, provider, or custom tags, alongside efficiency signals like cache hit ratio and cost per request. Cost Savings Opportunities flag avoidable spend, such as uncached prompt prefixes or full conversation history resent every turn, and estimate potential savings, for example raising a cache hit ratio from 0% toward 55% or 80%. Engineers can trace expensive LLM calls, inspect execution graphs, and validate changes with Experiments. The feature is free for up to 40,000 LLM spans per month. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How can I figure out why my AI agent's LLM bill suddenly went up? Break down cost by application, provider, model, token type, environment, service, or version to isolate the cause, since a higher bill could reflect more traffic, a model change, poor prompt-cache utilization, or an agent loop. Comparing average cost per request, cache hit ratio, and cache reuse ratio period-over-period helps distinguish a traffic increase (e.g. bill up 40% on 40% more traffic) from an efficiency regression. _Developers chasing down a cost spike can find deeper agent-cost breakdowns on daily.dev._ ### What is prompt caching and why does a low cache hit ratio increase LLM costs? Prompt caching reuses previously processed prompt content instead of reprocessing it on every call, and a low cache hit ratio means that reuse is limited, driving up token processing costs. Common causes include dynamic content that repeatedly changes a reusable prompt prefix, inconsistent message formatting, repeatedly re-created prompt input, or tool definitions that change between calls. _Teams optimizing token spend can track caching patterns and fixes like this on daily.dev._ ### How much does Datadog charge for Agent Observability (LLM observability)? Datadog Agent Observability is free for customers submitting up to 40,000 LLM spans per month. Beyond that threshold pricing is not specified, but teams can start with a 14-day free trial of Datadog to evaluate the product before committing. _Anyone comparing observability tools for AI agents can weigh pricing details like these on daily.dev._ ## Similar posts on daily.dev - [AI cost observability: A practical guide to understanding and managing LLM spend](https://daily.dev/posts/ai-cost-observability-a-practical-guide-to-understanding-and-managing-llm-spend-8pc0rjuej) · portkey · 0 upvotes · 0 comments - [Agent Observability FAQ: Understand the value of monitoring, evaluating, and improving your AI agents](https://daily.dev/posts/agent-observability-faq-understand-the-value-of-monitoring-evaluating-and-improving-your-ai-agent-w98akjbnj) · Grafana Labs · 1 upvotes · 0 comments - [Driving AI ROI: How Datadog connects cost, performance, and infrastructure so you can scale responsibly](https://daily.dev/posts/driving-ai-roi-how-datadog-connects-cost-performance-and-infrastructure-so-you-can-scale-responsi-mdbisz6nm) · Datadog · 1 upvotes · 0 comments - [AI Cost Visibility: How to Track and Optimize Token Spend Before the Invoice Arrives](https://daily.dev/posts/ai-cost-visibility-how-to-track-and-optimize-token-spend-before-the-invoice-arrives-133h7kulz) · Telerik · 1 upvotes · 1 comments - [You can’t debug what you can’t see — Observability for AI Agents](https://daily.dev/posts/you-can-t-debug-what-you-can-t-see-observability-for-ai-agents-8yaiqpabv) · CNCF · 1 upvotes · 0 comments --- Tags: [#devops](https://daily.dev/tags/devops), [#llm](https://daily.dev/tags/llm), [#ai-agents](https://daily.dev/tags/ai-agents), [#observability](https://daily.dev/tags/observability) [View this post on daily.dev](https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Optimize AI costs with Agent Observability","url":"https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu"},"datePublished":"2026-10-22T16:03:38.460Z","dateModified":"2026-10-22T16:18:14.707Z","description":"Datadog's Agent Observability ties AI spend to the applications and traces that generate it, instead of just API keys and models. The Cost page breaks down...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/432dd3324bd5201aee12392a156a37bd?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/432dd3324bd5201aee12392a156a37bd?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Datadog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Datadog","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/8f9d7e3e4bd64bd7b9db9b2ea83e0c6a","url":"https://daily.dev/sources/datadog"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devops,llm,ai-agents,observability","timeRequired":"PT9M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Datadog","item":"https://daily.dev/sources/datadog"},{"@type":"ListItem","position":3,"name":"Optimize AI costs with Agent Observability"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/optimize-ai-costs-with-agent-observability-lnsouoalu#faq","mainEntity":[{"@type":"Question","name":"How can I figure out why my AI agent's LLM bill suddenly went up?","acceptedAnswer":{"@type":"Answer","text":"Break down cost by application, provider, model, token type, environment, service, or version to isolate the cause, since a higher bill could reflect more traffic, a model change, poor prompt-cache utilization, or an agent loop. Comparing average cost per request, cache hit ratio, and cache reuse ratio period-over-period helps distinguish a traffic increase (e.g. bill up 40% on 40% more traffic) from an efficiency regression. Developers chasing down a cost spike can find deeper agent-cost breakdowns on daily.dev."}},{"@type":"Question","name":"What is prompt caching and why does a low cache hit ratio increase LLM costs?","acceptedAnswer":{"@type":"Answer","text":"Prompt caching reuses previously processed prompt content instead of reprocessing it on every call, and a low cache hit ratio means that reuse is limited, driving up token processing costs. Common causes include dynamic content that repeatedly changes a reusable prompt prefix, inconsistent message formatting, repeatedly re-created prompt input, or tool definitions that change between calls. Teams optimizing token spend can track caching patterns and fixes like this on daily.dev."}},{"@type":"Question","name":"How much does Datadog charge for Agent Observability (LLM observability)?","acceptedAnswer":{"@type":"Answer","text":"Datadog Agent Observability is free for customers submitting up to 40,000 LLM spans per month. Beyond that threshold pricing is not specified, but teams can start with a 14-day free trial of Datadog to evaluate the product before committing. Anyone comparing observability tools for AI agents can weigh pricing details like these on daily.dev."}}]} ```