---
title: "Operating Kubernetes at scale: a few stories from running Amazon EKS"
url: https://daily.dev/posts/operating-kubernetes-at-scale-a-few-stories-from-running-amazon-eks-vdcgnhxcm
source_url: https://thenewstack.io/eks-kubernetes-etcd-scale
type: article
source: "The New Stack"
published: 2026-06-30T13:04:38.547Z
updated: 2026-07-01T10:22:31.091Z
tags: ["aws", "kubernetes", "distributed-systems"]
reading_time: 14
upvotes: 1
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Operating Kubernetes at scale: a few stories from running Amazon EKS

**[The New Stack](https://daily.dev/sources/newstack)** · 14 min read · 1 upvotes · 0 comments

## Summary

Amazon EKS engineers share how they operate Kubernetes at fleet scale across hundreds of thousands of clusters. Key architectural changes include replacing etcd's Raft consensus with a purpose-built durable journal (eliminating quorum-loss failures and moving etcd to in-memory storage), collocating etcd with the API server for lower latency, and partitioning etcd into resource-specific shards for failure isolation. The post covers upstream Kubernetes fixes for watch-cache locking contention, HPA mutex bottlenecks, and scheduler inefficiencies. It also introduces EKS Provisioned Control Plane, which lets customers reserve control plane capacity in explicit tiers (XL–8XL) with SLA guarantees. Edge deployments on AWS Outposts use the same stack with self-healing etcd and offline-tolerant observability. Three operational lessons are shared: work queue depth as a better health signal than liveness probes, maintenance ordering to avoid blocking writes during etcd defragmentation, and keeping liveness and readiness signals strictly separate.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://thenewstack.io/eks-kubernetes-etcd-scale>

## Similar posts on daily.dev

- [Amazon EKS now supports advanced Kubernetes control plane configuration parameters](https://daily.dev/posts/amazon-eks-now-supports-advanced-kubernetes-control-plane-configuration-parameters-prou1ktn3) · AWS · 0 upvotes · 0 comments

---

Tags: [#aws](https://daily.dev/tags/aws), [#kubernetes](https://daily.dev/tags/kubernetes), [#distributed-systems](https://daily.dev/tags/distributed-systems)

[View this post on daily.dev](https://daily.dev/posts/operating-kubernetes-at-scale-a-few-stories-from-running-amazon-eks-vdcgnhxcm)