--- title: Databricks’ native monitoring resources | daily.dev description: A deep dive into the native monitoring resources Databricks offers for tracking performance, cost, and usage across data engineering, analytics, and Model... canonical: https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Databricks’ native monitoring resources | daily.dev og:description: A deep dive into the native monitoring resources Databricks offers for tracking performance, cost, and usage across data engineering, analytics, and Model... og:url: https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj og:image: https://api.daily.dev/og/posts/rWbjvjAWj.png og:image:alt: Databricks’ native monitoring resources og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Databricks’ native monitoring resources **[Datadog](https://daily.dev/sources/datadog)** · 8 min read · 0 upvotes · 0 comments ## Summary A deep dive into the native monitoring resources Databricks offers for tracking performance, cost, and usage across data engineering, analytics, and Model Serving workloads. Covers system tables (billing, compute, lakeflow, query history, access/lineage, ai_gateway.usage) and their latency limitations, the Spark UI for troubleshooting classic compute, job notifications and the Jobs API for real-time alerting, SQL warehouse dashboards, data quality and lineage tooling via Unity Catalog, and Model Serving endpoint metrics exposed in OpenMetrics format. Positioned as part two of a series, with part three covering Datadog's own Databricks integration. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do I get real-time alerts for Databricks job failures since system tables aren't real-time? Use Databricks job notifications rather than system tables for real-time alerting, since system.lakeflow.* data is not updated live. Job notifications can trigger on job success, failure, start, or exceeding expected durations, and route to email, Slack, Microsoft Teams, PagerDuty, or any HTTP webhook, in combination with Jobs API queries for near-real-time status checks. _daily.dev surfaces practical guidance like this for engineers building reliable data pipeline alerting._ ### What system table do I query for Databricks billing and cost data? Query system.billing.usage, which is enabled by default and includes cost data for all billable usage across workspaces in the same cloud region under an account. Other system table schemas, such as compute, query, lakeflow, and access tables, must be enabled manually through the system schemas API and accessed via Unity Catalog-enabled workspaces. _Engineers tracking cloud data platform costs can find deep dives like this through daily.dev._ ### How can I monitor Databricks Model Serving endpoint metrics in Prometheus or Datadog? Databricks exposes endpoint health metrics in OpenMetrics format at https://[DATABRICKS_HOST]/api/2.0/serving-endpoints/[ENDPOINT]/metrics, allowing live request counts, error counts, latency, and compute usage to be scraped by Prometheus, Datadog, or any OpenMetrics-compatible agent. The Databricks Serving UI also shows the previous 14 days of these metrics directly. _daily.dev helps ML engineers keep up with evolving observability options for AI model serving infrastructure._ ## Similar posts on daily.dev - [Monitor Databricks with Datadog](https://daily.dev/posts/monitor-databricks-with-datadog-giqfytj4u) · Datadog · 0 upvotes · 0 comments - [Key metrics for monitoring Databricks](https://daily.dev/posts/key-metrics-for-monitoring-databricks-hyjef9qqr) · Datadog · 1 upvotes · 0 comments - [Turn Databricks telemetry into actionable decisions with Dynatrace](https://daily.dev/posts/turn-databricks-telemetry-into-actionable-decisions-with-dynatrace-t6vr2eibt) · Dynatrace · 1 upvotes · 0 comments - [Monitor Databricks with Grafana Cloud for instant visibility into your workloads](https://daily.dev/posts/monitor-databricks-with-grafana-cloud-for-instant-visibility-into-your-workloads-fmsak5z0j) · Grafana Labs · 0 upvotes · 0 comments --- Tags: [#devops](https://daily.dev/tags/devops), [#observability](https://daily.dev/tags/observability), [#data-engineering](https://daily.dev/tags/data-engineering), [#apache-spark](https://daily.dev/tags/apache-spark), [#databricks](https://daily.dev/tags/databricks) [View this post on daily.dev](https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Databricks’ native monitoring resources","url":"https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj"},"datePublished":"2026-10-02T16:41:42.610Z","dateModified":"2026-10-02T16:44:33.408Z","description":"A deep dive into the native monitoring resources Databricks offers for tracking performance, cost, and usage across data engineering, analytics, and Model...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/81f869364e7d98f510865fa42cd11366?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/81f869364e7d98f510865fa42cd11366?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Datadog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Datadog","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/8f9d7e3e4bd64bd7b9db9b2ea83e0c6a","url":"https://daily.dev/sources/datadog"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devops,observability,data-engineering,apache-spark,databricks","timeRequired":"PT8M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Datadog","item":"https://daily.dev/sources/datadog"},{"@type":"ListItem","position":3,"name":"Databricks’ native monitoring resources"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/databricks-native-monitoring-resources-rwbjvjawj#faq","mainEntity":[{"@type":"Question","name":"How do I get real-time alerts for Databricks job failures since system tables aren't real-time?","acceptedAnswer":{"@type":"Answer","text":"Use Databricks job notifications rather than system tables for real-time alerting, since system.lakeflow.* data is not updated live. Job notifications can trigger on job success, failure, start, or exceeding expected durations, and route to email, Slack, Microsoft Teams, PagerDuty, or any HTTP webhook, in combination with Jobs API queries for near-real-time status checks. daily.dev surfaces practical guidance like this for engineers building reliable data pipeline alerting."}},{"@type":"Question","name":"What system table do I query for Databricks billing and cost data?","acceptedAnswer":{"@type":"Answer","text":"Query system.billing.usage, which is enabled by default and includes cost data for all billable usage across workspaces in the same cloud region under an account. Other system table schemas, such as compute, query, lakeflow, and access tables, must be enabled manually through the system schemas API and accessed via Unity Catalog-enabled workspaces. Engineers tracking cloud data platform costs can find deep dives like this through daily.dev."}},{"@type":"Question","name":"How can I monitor Databricks Model Serving endpoint metrics in Prometheus or Datadog?","acceptedAnswer":{"@type":"Answer","text":"Databricks exposes endpoint health metrics in OpenMetrics format at https://[DATABRICKS_HOST]/api/2.0/serving-endpoints/[ENDPOINT]/metrics, allowing live request counts, error counts, latency, and compute usage to be scraped by Prometheus, Datadog, or any OpenMetrics-compatible agent. The Databricks Serving UI also shows the previous 14 days of these metrics directly. daily.dev helps ML engineers keep up with evolving observability options for AI model serving infrastructure."}}]} ```