--- title: The Common Pile v0.1 # | daily.dev description: EleutherAI announces the Common Pile v0.1, an 8TB corpus of openly licensed and public domain text for training large language models, developed over two years... canonical: https://daily.dev/posts/the-common-pile-v0-1--7suoowbry twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: The Common Pile v0.1 # | daily.dev og:description: EleutherAI announces the Common Pile v0.1, an 8TB corpus of openly licensed and public domain text for training large language models, developed over two years... og:url: https://daily.dev/posts/the-common-pile-v0-1--7suoowbry og:image: https://api.daily.dev/og/posts/7suoOwBRY.png og:image:alt: The Common Pile v0.1 # og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # The Common Pile v0.1 # **[EleutherAI](https://daily.dev/sources/eleutherai)** · 11 min read · 0 upvotes · 0 comments ## Summary EleutherAI announces the Common Pile v0.1, an 8TB corpus of openly licensed and public domain text for training large language models, developed over two years in collaboration with institutions including the University of Toronto, Hugging Face, and AI2. The release also includes two 7B parameter models (Comma v0.1-1T and Comma v0.1-2T) trained on the dataset. The post argues that public release of training data is essential for scientific reproducibility, accountability, and transparency, noting that lawsuits have caused major AI companies to become less transparent about their training data. Benchmark results show Comma v0.1 performs comparably to models trained on unlicensed data, challenging the assumption that openly licensed data produces inferior models. The team plans to expand the dataset and establish partnerships with cultural heritage institutions to unlock more public domain content. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Datasets for Training a Language Model](https://daily.dev/posts/datasets-for-training-a-language-model-prbkjavpx) · Machine Learning Mastery · 4 upvotes · 0 comments - [Cohere says AI sovereignty matters — except it just gated its new translation model for commercial use](https://daily.dev/posts/cohere-says-ai-sovereignty-matters-except-it-just-gated-its-new-translation-model-for-commercial-u-ijnoznmnk) · The New Stack · 0 upvotes · 0 comments - [Hugging Face Releases FineTranslations, a Trillion-Token Multilingual Parallel Text Dataset](https://daily.dev/posts/hugging-face-releases-finetranslations-a-trillion-token-multilingual-parallel-text-dataset-ilbhxxjto) · InfoQ · 0 upvotes · 0 comments - [How NVIDIA Builds Open Data for AI](https://daily.dev/posts/how-nvidia-builds-open-data-for-ai-07bdy4xen) · Hugging Face · 1 upvotes · 0 comments --- Tags: [#open-source](https://daily.dev/tags/open-source), [#llm](https://daily.dev/tags/llm) [View this post on daily.dev](https://daily.dev/posts/the-common-pile-v0-1--7suoowbry) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"The Common Pile v0.1 #","url":"https://daily.dev/posts/the-common-pile-v0-1--7suoowbry","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/the-common-pile-v0-1--7suoowbry"},"datePublished":"2026-08-02T07:04:30.613Z","dateModified":"2026-08-02T07:31:47.511Z","description":"EleutherAI announces the Common Pile v0.1, an 8TB corpus of openly licensed and public domain text for training large language models, developed over two years...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/a38246661e11771b13836ae357d89948?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/a38246661e11771b13836ae357d89948?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"EleutherAI","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"EleutherAI","logo":"https://media.daily.dev/image/upload/s--aAcRyWGF--/f_auto,q_auto/v1785654263/logos/eleutherai","url":"https://daily.dev/sources/eleutherai"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/the-common-pile-v0-1--7suoowbry","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"open-source,llm","timeRequired":"PT11M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"EleutherAI","item":"https://daily.dev/sources/eleutherai"},{"@type":"ListItem","position":3,"name":"The Common Pile v0.1 #"}]} ```