--- title: "Tar saved Unix backups in 1979. Now it saves your dataloader." url: https://daily.dev/posts/tar-saved-unix-backups-in-1979-now-it-saves-your-dataloader--zdcgqk8hp source_url: https://www.tigrisdata.com/blog/bundle-api type: article source: "Tigris" published: 2026-06-16T17:43:20.553Z updated: 2026-06-17T15:52:10.491Z tags: ["machine-learning"] reading_time: 8 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Tar saved Unix backups in 1979. Now it saves your dataloader. **[Tigris](https://daily.dev/sources/tigris)** · 8 min read · 0 upvotes · 0 comments ## Summary Tigris has introduced a bundle API that lets you fetch thousands of objects from object storage in a single HTTP request, returning them as a streaming tar archive. This directly addresses the ML training bottleneck where dataloaders need thousands of small files per batch but object storage forces one GET per object. The post explains the latency math (4,000 sequential GETs at 30ms each = 120 seconds vs. one round trip), how the streaming tar format works server-side without buffering, error handling via skip/fail modes, limits (5,000 keys, 50 GB, 15-min timeout), and includes SDK examples for Python, Go, JavaScript, and cURL, plus a PyTorch IterableDataset integration example. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Benchmarking ML Training Throughput on Tigris Object Storage](https://daily.dev/posts/benchmarking-ml-training-throughput-on-tigris-object-storage-zhhbntwu3) · Tigris · 0 upvotes · 0 comments - [Getting started with PyTorch and Tigris](https://daily.dev/posts/getting-started-with-pytorch-and-tigris-xfgaggiv1) · Tigris · 0 upvotes · 0 comments - [Fifty agents for the price of one bucket](https://daily.dev/posts/fifty-agents-for-the-price-of-one-bucket-sjcdkmhnz) · Tigris · 1 upvotes · 0 comments - [2025: A Breakthrough Year for Tigris Data](https://daily.dev/posts/2025-a-breakthrough-year-for-tigris-data-fdomvg887) · Tigris · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning) [View this post on daily.dev](https://daily.dev/posts/tar-saved-unix-backups-in-1979-now-it-saves-your-dataloader--zdcgqk8hp)