---
title: "Big Bite: Ingesting Performance of Large Clusters"
url: https://daily.dev/posts/big-bite-ingesting-performance-of-large-clusters-9lbvr5cih
source_url: https://cratedb.com/blog/big-cluster-insights-ingesting
type: article
source: "CrateDB"
published: 2026-06-04T21:09:31.557Z
updated: 2026-06-04T21:09:52.771Z
tags: ["database", "data-engineering", "distributed-systems", "cratedb"]
reading_time: 7
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Big Bite: Ingesting Performance of Large Clusters

**[CrateDB](https://daily.dev/sources/cratedb)** · 7 min read · 0 upvotes · 0 comments

## Summary

A performance benchmark study of a 56-node CrateDB cluster on Microsoft Azure, achieving up to 4.8 million records per second ingestion. The post covers the hardware setup (D12v2/D14v2 VMs with SSD storage), bulk insert strategies using Python load generators, shard configuration tuning (optimal ratio of ~2 shards per node), memory and I/O settings (heap allocation, mmapfs, store throttle), and the impact of horizontal scaling on write throughput. Key findings: doubling data nodes from 14 to 28 nearly doubled ingestion rates, and disabling replication and refresh during bulk loads significantly improves performance.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://cratedb.com/blog/big-cluster-insights-ingesting>

## Similar posts on daily.dev

- [Scale smart, not just big: a practical guide to multi-node Amazon Timestream for InfluxDB 3 Enterprise](https://daily.dev/posts/scale-smart-not-just-big-a-practical-guide-to-multi-node-amazon-timestream-for-influxdb-3-enterpri-q22yyrs1w) · AWS Database Blog · 0 upvotes · 0 comments
- [High Cardinality in ClickHouse at Scale: What Actually Breaks](https://daily.dev/posts/high-cardinality-in-clickhouse-at-scale-what-actually-breaks-pc6axtguq) · Last9 · 0 upvotes · 0 comments
- [Inside CrateDB: How Storage Optimization Powers Real-Time Analytics at Scale](https://daily.dev/posts/inside-cratedb-how-storage-optimization-powers-real-time-analytics-at-scale-3iozebt7s) · CrateDB · 0 upvotes · 0 comments

---

Tags: [#database](https://daily.dev/tags/database), [#data-engineering](https://daily.dev/tags/data-engineering), [#distributed-systems](https://daily.dev/tags/distributed-systems), [#cratedb](https://daily.dev/tags/cratedb)

[View this post on daily.dev](https://daily.dev/posts/big-bite-ingesting-performance-of-large-clusters-9lbvr5cih)