Agoda's engineering team built Storefront, a Rust-based S3-compatible reverse proxy using Cloudflare's Pingora framework, to overcome DNS round-robin load balancing limitations in their large-scale object storage infrastructure. The proxy implements latency-aware routing with a least-in-flight algorithm, IO timeout safeguards, cross-data-center traffic isolation, and optimized HTTP Expect: 100-continue handling for uploads. It also provides credential-less authentication by identifying Kubernetes pods internally, centralizing access control without exposing credentials to services. Observability is handled via OpenTelemetry, exposing metrics on performance, traffic patterns, and S3 API usage.
752 Impressions