--- title: "Scaling AI/ML Infrastructure at Uber" url: https://daily.dev/posts/scaling-ai-ml-infrastructure-at-uber-rdn0prjic source_url: https://www.uber.com/blog/scaling-ai-ml-infrastructure-at-uber/ type: article source: "Uber Engineering" published: 2024-04-22T06:19:29.829Z updated: 2024-05-09T09:09:48.658Z tags: ["cloud", "machine-learning", "gpu", "uber"] reading_time: 8 upvotes: 4 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Scaling AI/ML Infrastructure at Uber **[Uber Engineering](https://daily.dev/sources/uber)** · 8 min read · 4 upvotes · 0 comments ## Summary Uber has made significant progress in scaling their AI/ML infrastructure, transitioning from on-prem to cloud infrastructure and optimizing existing infrastructure. They have implemented a unified federation layer for batch workloads, upgraded network bandwidth for training efficiency, and upgraded memory to improve GPU allocation rates. They are also building new infrastructure by evaluating price-performance ratios of cloud SKUs and improving LLM training efficiency through memory offload. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#cloud](https://daily.dev/tags/cloud), [#machine-learning](https://daily.dev/tags/machine-learning), [#gpu](https://daily.dev/tags/gpu), [#uber](https://daily.dev/tags/uber) [View this post on daily.dev](https://daily.dev/posts/scaling-ai-ml-infrastructure-at-uber-rdn0prjic)