--- title: TorchTPU: Running PyTorch Natively on TPUs at Google Scale description: Google's TorchTPU is a new engineering stack enabling PyTorch to run natively on TPU hardware with minimal code changes. Built on an 'Eager First' philosophy... canonical: https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: TorchTPU: Running PyTorch Natively on TPUs at Google Scale | daily.dev og:description: Google's TorchTPU is a new engineering stack enabling PyTorch to run natively on TPU hardware with minimal code changes. Built on an 'Eager First' philosophy... og:url: https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb og:image: https://api.daily.dev/og/posts/WNrth1JYb.png og:image:alt: TorchTPU: Running PyTorch Natively on TPUs at Google Scale og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # TorchTPU: Running PyTorch Natively on TPUs at Google Scale **[Google Developers](https://daily.dev/sources/googledevs)** · 7 min read · 0 upvotes · 0 comments ## Summary Google's TorchTPU is a new engineering stack enabling PyTorch to run natively on TPU hardware with minimal code changes. Built on an 'Eager First' philosophy using PyTorch's PrivateUse1 interface, it offers three execution modes: Debug Eager (synchronous, for debugging), Strict Eager (asynchronous, mirrors standard PyTorch), and Fused Eager (auto-fuses operations for 50–100%+ performance gains). For peak performance, it integrates with torch.compile via XLA as the backend compiler, translating PyTorch operators to StableHLO IR. TorchTPU supports DDP, FSDPv2, and DTensor for distributed workloads, and adds MPMD support to handle divergent execution across ranks — a key limitation of its predecessor PyTorch/XLA. Custom kernels via Pallas and JAX are supported. The 2026 roadmap includes bounded dynamism for dynamic shapes, precompiled kernel libraries, and broader ecosystem integration. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [TorchTPU: Running PyTorch Natively on TPUs at Google Scale](https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-vntmbrdik) · Hacker News · 2 upvotes · 0 comments - [vLLM TPU: A New Unified Backend Supporting PyTorch and JAX on TPU](https://daily.dev/posts/vllm-tpu-a-new-unified-backend-supporting-pytorch-and-jax-on-tpu-ctdrn8aua) · vLLM · 1 upvotes · 0 comments - [Inside the Ironwood TPU codesigned AI stack](https://daily.dev/posts/inside-the-ironwood-tpu-codesigned-ai-stack-sj7x9t924) · Google Cloud · 0 upvotes · 0 comments - [TPU 8t and TPU 8i technical deep dive](https://daily.dev/posts/tpu-8t-and-tpu-8i-technical-deep-dive-u5h1xk1ga) · Google Cloud · 0 upvotes · 0 comments - [Google splits its TPU line in two for the agentic era](https://daily.dev/posts/google-splits-its-tpu-line-in-two-for-the-agentic-era-zbjc2yyc7) · The New Stack · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#pytorch](https://daily.dev/tags/pytorch) [View this post on daily.dev](https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"TorchTPU: Running PyTorch Natively on TPUs at Google Scale","url":"https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb"},"datePublished":"2026-04-07T15:06:08.936Z","dateModified":"2026-04-07T15:06:38.908Z","description":"Google's TorchTPU is a new engineering stack enabling PyTorch to run natively on TPU hardware with minimal code changes. Built on an 'Eager First' philosophy...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/6cae529dce5dcdac9a97be6d7bc5d0fe?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/6cae529dce5dcdac9a97be6d7bc5d0fe?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Google Developers","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Google Developers","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/ea4bbded4e7f45ccb82e121a3156535f","url":"https://daily.dev/sources/googledevs"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/torchtpu-running-pytorch-natively-on-tpus-at-google-scale-wnrth1jyb","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,pytorch","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Google Developers","item":"https://daily.dev/sources/googledevs"},{"@type":"ListItem","position":3,"name":"TorchTPU: Running PyTorch Natively on TPUs at Google Scale"}]} ```