--- title: "Rust BufWriter and LZ4 Compression" url: https://daily.dev/posts/rust-bufwriter-and-lz4-compression-7acudhppl source_url: https://deterministic.space/bufwriter-lz4.html type: article source: "Pascal’s scribbles" published: 2025-07-09T19:07:46.360Z updated: 2025-07-09T19:08:08.351Z tags: ["performance", "rust"] reading_time: 4 upvotes: 6 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Rust BufWriter and LZ4 Compression **[Pascal’s scribbles](https://daily.dev/sources/deterministicspace)** · 4 min read · 6 upvotes · 0 comments ## Summary A Rust developer working with bioinformatics data discovered a significant performance optimization when using LZ4 compression. By swapping the order of BufWriter and LZ4 Encoder in the chain (buffering writes to the encoder instead of to the file), they achieved a 1.83x speed improvement. The issue was that small MessagePack chunks (~250 bytes) were causing excessive LZ4 block operations, and buffering at the encoder level reduced these costly operations. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#performance](https://daily.dev/tags/performance), [#rust](https://daily.dev/tags/rust) [View this post on daily.dev](https://daily.dev/posts/rust-bufwriter-and-lz4-compression-7acudhppl)