--- title: Chapter I: The birth of Parquet | daily.dev description: This post discusses the birth of Parquet, a columnar storage format for Hadoop, and its integration into the open source data stack. It covers the main tools... canonical: https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Chapter I: The birth of Parquet | daily.dev og:description: This post discusses the birth of Parquet, a columnar storage format for Hadoop, and its integration into the open source data stack. It covers the main tools... og:url: https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7 og:image: https://api.daily.dev/og/posts/jZ1c8fye7.png og:image:alt: Chapter I: The birth of Parquet og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Chapter I: The birth of Parquet **[Hacker News](https://daily.dev/sources/hn)** · 8 min read · 0 upvotes · 0 comments ## Summary This post discusses the birth of Parquet, a columnar storage format for Hadoop, and its integration into the open source data stack. It covers the main tools used in the data platform at Twitter, the benefits of organizing data in a columnar layout, and the importance of project governance and open source foundations. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#open-source](https://daily.dev/tags/open-source), [#data-processing](https://daily.dev/tags/data-processing) [View this post on daily.dev](https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Chapter I: The birth of Parquet","url":"https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7"},"datePublished":"2024-05-08T15:40:42.643Z","dateModified":"2024-05-09T08:22:04.995Z","description":"This post discusses the birth of Parquet, a columnar storage format for Hadoop, and its integration into the open source data stack. It covers the main tools...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0791eb7320786f125fe432dba0703ab5?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0791eb7320786f125fe432dba0703ab5?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Hacker News","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Hacker News","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/hn","url":"https://daily.dev/sources/hn"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/chapter-i-the-birth-of-parquet-jz1c8fye7","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"open-source,data-processing","timeRequired":"PT8M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Hacker News","item":"https://daily.dev/sources/hn"},{"@type":"ListItem","position":3,"name":"Chapter I: The birth of Parquet"}]} ```