--- title: Benchmarks and Obscurantism: A “red” line that should... description: ClickHouse's product manager investigates a Databricks keynote benchmark that claimed ClickHouse 'crashed' under load during the Reyden announcement. The... canonical: https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Benchmarks and Obscurantism: A “red” line that should not be crossed | daily.dev og:description: ClickHouse's product manager investigates a Databricks keynote benchmark that claimed ClickHouse 'crashed' under load during the Reyden announcement. The... og:url: https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip og:image: https://api.daily.dev/og/posts/2t9CuLVIp.png og:image:alt: Benchmarks and Obscurantism: A “red” line that should not be crossed og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Benchmarks and Obscurantism: A “red” line that should not be crossed **[ClickHouse](https://daily.dev/sources/clickhouse)** · 10 min read · 0 upvotes · 0 comments ## Summary ClickHouse's product manager investigates a Databricks keynote benchmark that claimed ClickHouse 'crashed' under load during the Reyden announcement. The author attempts to reproduce the crash using TPC-H SF1 data and finds ClickHouse does not crash — it gracefully rejects queries at a configurable concurrency limit. The post argues the Databricks benchmark was opaque, used tiny datasets (fitting in iPhone memory), provided no hardware or configuration details, and was run on a product competitors cannot yet access. The author demonstrates that with proper node sizing (35 nodes for 15K QPS), ClickHouse handles the load without tuning. The broader argument is that benchmarks must be open, reproducible, and detailed to be meaningful, contrasting Databricks' approach with ClickHouse's public GitHub benchmark repository. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [PostgresBench: A Reproducible Benchmark for Postgres Services](https://daily.dev/posts/postgresbench-a-reproducible-benchmark-for-postgres-services-vzebpsymu) · ClickHouse · 1 upvotes · 0 comments - [Introducing CostBench: an open benchmark for data warehouse cost-performance](https://daily.dev/posts/introducing-costbench-an-open-benchmark-for-data-warehouse-cost-performance-0ikhwlzbk) · ClickHouse · 0 upvotes · 0 comments - [Measuring real-time performance per dollar under continuous load: CostBench’s first end-to-end results](https://daily.dev/posts/measuring-real-time-performance-per-dollar-under-continuous-load-costbench-s-first-end-to-end-resul-rz7x2emyv) · ClickHouse · 1 upvotes · 0 comments --- Tags: [#database](https://daily.dev/tags/database), [#backend](https://daily.dev/tags/backend), [#databricks](https://daily.dev/tags/databricks), [#clickhouse](https://daily.dev/tags/clickhouse) [View this post on daily.dev](https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Benchmarks and Obscurantism: A “red” line that should not be crossed","url":"https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip"},"datePublished":"2026-06-29T10:09:23.650Z","dateModified":"2026-06-29T10:09:52.348Z","description":"ClickHouse's product manager investigates a Databricks keynote benchmark that claimed ClickHouse 'crashed' under load during the Reyden announcement. The...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/628e6fa4dbeb435ec18d489edc6bc372?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/628e6fa4dbeb435ec18d489edc6bc372?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"ClickHouse","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"ClickHouse","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/clickhouse","url":"https://daily.dev/sources/clickhouse"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-2t9culvip","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"database,backend,databricks,clickhouse","timeRequired":"PT10M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"ClickHouse","item":"https://daily.dev/sources/clickhouse"},{"@type":"ListItem","position":3,"name":"Benchmarks and Obscurantism: A “red” line that should not be crossed"}]} ```