--- title: How Buildkite transformed test analytics and cut costs... description: Buildkite migrated their Test Engine analytics from a complex Flink-based pre-aggregation system to ClickHouse Cloud, enabling real-time analytics on billions... canonical: https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: How Buildkite transformed test analytics and cut costs with ClickHouse Cloud | daily.dev og:description: Buildkite migrated their Test Engine analytics from a complex Flink-based pre-aggregation system to ClickHouse Cloud, enabling real-time analytics on billions... og:url: https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml og:image: https://api.daily.dev/og/posts/JAWEznKml.png og:image:alt: How Buildkite transformed test analytics and cut costs with ClickHouse Cloud og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # How Buildkite transformed test analytics and cut costs with ClickHouse Cloud **[ClickHouse](https://daily.dev/sources/clickhouse)** · 10 min read · 3 upvotes · 0 comments ## Summary Buildkite migrated their Test Engine analytics from a complex Flink-based pre-aggregation system to ClickHouse Cloud, enabling real-time analytics on billions of test executions with arbitrary metadata tags. The migration simplified their architecture by retiring DynamoDB, reducing Aurora and Flink usage, and cutting infrastructure costs by five figures monthly despite quadrupling ingestion to 12 billion events per month. ClickHouse now handles 25K events/second ingestion and powers on-demand queries that previously required constant pre-computation, giving customers flexible, interactive analytics without canned reports. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [How ClickHouse Cloud enabled LaunchDarkly to build and ship features faster](https://daily.dev/posts/how-clickhouse-cloud-enabled-launchdarkly-to-build-and-ship-features-faster-k8tdindrt) · ClickHouse · 1 upvotes · 0 comments - [Powering self-driving vehicle analytics at Avride with ClickHouse Cloud](https://daily.dev/posts/powering-self-driving-vehicle-analytics-at-avride-with-clickhouse-cloud-9mzpwcfor) · ClickHouse · 0 upvotes · 0 comments - [From Millions to Billions](https://daily.dev/posts/from-millions-to-billions-pxrx7g23w) · Hacker News · 110 upvotes · 2 comments - [Running out of runway: migrating Temporal Cloud's billing store to ClickHouse](https://daily.dev/posts/running-out-of-runway-migrating-temporal-cloud-s-billing-store-to-clickhouse-rpxl3uwjt) · Temporal · 0 upvotes · 0 comments --- Tags: [#cicd](https://daily.dev/tags/cicd), [#kafka](https://daily.dev/tags/kafka), [#data-engineering](https://daily.dev/tags/data-engineering), [#clickhouse](https://daily.dev/tags/clickhouse) [View this post on daily.dev](https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"How Buildkite transformed test analytics and cut costs with ClickHouse Cloud","url":"https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml"},"datePublished":"2026-01-27T12:04:39.189Z","dateModified":"2026-01-27T12:05:01.766Z","description":"Buildkite migrated their Test Engine analytics from a complex Flink-based pre-aggregation system to ClickHouse Cloud, enabling real-time analytics on billions...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ff6b71f7a7bf82002a5c64efc3bd6f3f?_a=AQAEulh","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/ff6b71f7a7bf82002a5c64efc3bd6f3f?_a=AQAEulh","isAccessibleForFree":true,"articleSection":"ClickHouse","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ClickHouse","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/clickhouse","url":"https://daily.dev/sources/clickhouse"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/how-buildkite-transformed-test-analytics-and-cut-costs-with-clickhouse-cloud-jaweznkml","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":3},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"cicd,kafka,data-engineering,clickhouse","timeRequired":"PT10M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ClickHouse","item":"https://daily.dev/sources/clickhouse"},{"@type":"ListItem","position":3,"name":"How Buildkite transformed test analytics and cut costs with ClickHouse Cloud"}]} ```