--- title: Delta Lake - State of the Project - Part 1 | daily.dev description: Delta Lake, hosted under The Linux Foundation, now sees 20M monthly downloads and has grown a community of 500+ contributors across 4+ mainstream and 7+... canonical: https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Delta Lake - State of the Project - Part 1 | daily.dev og:description: Delta Lake, hosted under The Linux Foundation, now sees 20M monthly downloads and has grown a community of 500+ contributors across 4+ mainstream and 7+... og:url: https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj og:image: https://api.daily.dev/og/posts/at3uiCFuJ.png og:image:alt: Delta Lake - State of the Project - Part 1 og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Delta Lake - State of the Project - Part 1 **[Delta Lake Blog](https://daily.dev/sources/delta-lake)** · 10 min read · 0 upvotes · 0 comments ## Summary Delta Lake, hosted under The Linux Foundation, now sees 20M monthly downloads and has grown a community of 500+ contributors across 4+ mainstream and 7+ incubation projects. The community reached 40,000 LinkedIn followers and 9,300 Slack members, hosted twelve live events, and appeared at multiple open source conferences and in mainstream tech press. On the feature side, the year brought deletion vectors for faster merge-on-read updates, Liquid Clustering as a Z-order replacement, V2 checkpoints and log compactions enabling tables with 100M+ files, row tracking, column defaults, and a new 'table features' mechanism for incremental protocol upgrades, alongside major MERGE API improvements, Delta Uniform for Iceberg compatibility, and table cloning. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is deletion vectors in Delta Lake and how much faster does it make updates? Deletion vectors introduce a merge-on-read approach to Delta Lake where deleted or updated rows are marked in a bitmap instead of rewriting Parquet files immediately, making delete, update, and merge operations up to 10x faster without slowing down subsequent reads. Support was added incrementally: DELETE in Delta 2.4, UPDATE in Delta 3.0, and MERGE in Delta 3.1. _Teams evaluating lakehouse write performance can track Delta Lake feature rollouts like this on daily.dev._ ### How does Liquid Clustering differ from Z-order clustering in Delta Lake? Liquid Clustering, introduced in Delta 3.1 as a preview feature, replaces Z-order clustering (added in Delta Lake 2.0 via OPTIMIZE ZORDER) by using Hilbert curves for better data layout and more data skipping, Z-cubes to make clustering incremental and cut write amplification, and pluggable data layout policies, avoiding the repeated reclustering Z-order required. _Engineers choosing a clustering strategy for large tables can follow updates like this on daily.dev._ ### How many files can a single Delta Lake table reliably contain with V2 checkpoints? A single Delta Lake table can reliably contain 100 million or more files, equivalent to over 100 petabytes of data, thanks to V2 checkpoints and minor log compactions introduced in Delta 3.0. These optimizations let the transaction log, which can otherwise exceed 10 GB, be updated incrementally and read faster. _Anyone scaling data lake tables to petabyte size can track these format changes on daily.dev._ ## Similar posts on daily.dev - [Delta Lake Explained: Boost Data Reliability in Cloud Storage](https://daily.dev/posts/delta-lake-explained-boost-data-reliability-in-cloud-storage-oechbmvm4) · databricks · 0 upvotes · 0 comments - [Delta Kernel \(Rust\) and the future of the Lakehouse.](https://daily.dev/posts/delta-kernel-rust-and-the-future-of-the-lakehouse--twurulaae) · Confessions of a Data Guy · 15 upvotes · 1 comments - [DuckLake Architecture Deep Dive](https://daily.dev/posts/ducklake-architecture-deep-dive-yuky5mgag) · MotherDuck · 0 upvotes · 0 comments - [Advancing the Open Lakehouse with Apache Spark, the Delta Kernel, and the new UC Delta APIs](https://daily.dev/posts/advancing-the-open-lakehouse-with-apache-spark-the-delta-kernel-and-the-new-uc-delta-apis-dbaazlwws) · Delta Lake Blog · 0 upvotes · 0 comments - [DuckLake 1.0: Data Lake Format with SQL Catalog Metadata](https://daily.dev/posts/ducklake-1-0-data-lake-format-with-sql-catalog-metadata-i1k4mw1ne) · InfoQ · 0 upvotes · 0 comments --- Tags: [#open-source](https://daily.dev/tags/open-source), [#data-engineering](https://daily.dev/tags/data-engineering), [#apache-spark](https://daily.dev/tags/apache-spark) [View this post on daily.dev](https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Delta Lake - State of the Project - Part 1","url":"https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj"},"datePublished":"2026-08-16T08:53:39.508Z","dateModified":"2026-08-16T08:55:58.182Z","description":"Delta Lake, hosted under The Linux Foundation, now sees 20M monthly downloads and has grown a community of 500+ contributors across 4+ mainstream and 7+...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/9c840f4e38d8234dc7b83e05fb21bd29?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/9c840f4e38d8234dc7b83e05fb21bd29?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Delta Lake Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Delta Lake Blog","logo":"https://media.daily.dev/image/upload/s--7f2q9Asf--/f_auto,q_auto/v1786870393/logos/delta-lake?_a=BAMAMicg0","url":"https://daily.dev/sources/delta-lake"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"open-source,data-engineering,apache-spark","timeRequired":"PT10M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Delta Lake Blog","item":"https://daily.dev/sources/delta-lake"},{"@type":"ListItem","position":3,"name":"Delta Lake - State of the Project - Part 1"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/delta-lake---state-of-the-project---part-1-at3uicfuj#faq","mainEntity":[{"@type":"Question","name":"What is deletion vectors in Delta Lake and how much faster does it make updates?","acceptedAnswer":{"@type":"Answer","text":"Deletion vectors introduce a merge-on-read approach to Delta Lake where deleted or updated rows are marked in a bitmap instead of rewriting Parquet files immediately, making delete, update, and merge operations up to 10x faster without slowing down subsequent reads. Support was added incrementally: DELETE in Delta 2.4, UPDATE in Delta 3.0, and MERGE in Delta 3.1. Teams evaluating lakehouse write performance can track Delta Lake feature rollouts like this on daily.dev."}},{"@type":"Question","name":"How does Liquid Clustering differ from Z-order clustering in Delta Lake?","acceptedAnswer":{"@type":"Answer","text":"Liquid Clustering, introduced in Delta 3.1 as a preview feature, replaces Z-order clustering (added in Delta Lake 2.0 via OPTIMIZE ZORDER) by using Hilbert curves for better data layout and more data skipping, Z-cubes to make clustering incremental and cut write amplification, and pluggable data layout policies, avoiding the repeated reclustering Z-order required. Engineers choosing a clustering strategy for large tables can follow updates like this on daily.dev."}},{"@type":"Question","name":"How many files can a single Delta Lake table reliably contain with V2 checkpoints?","acceptedAnswer":{"@type":"Answer","text":"A single Delta Lake table can reliably contain 100 million or more files, equivalent to over 100 petabytes of data, thanks to V2 checkpoints and minor log compactions introduced in Delta 3.0. These optimizations let the transaction log, which can otherwise exceed 10 GB, be updated incrementally and read faster. Anyone scaling data lake tables to petabyte size can track these format changes on daily.dev."}}]} ```