--- title: "Helion on TPU: Towards Hardware Heterogeneous Kernel Authoring – PyTorch" url: https://daily.dev/posts/helion-on-tpu-towards-hardware-heterogeneous-kernel-authoring-pytorch-uvlidlhmw source_url: https://pytorch.org/blog/helion-on-tpu-towards-hardware-heterogeneous-kernel-authoring type: article source: "PyTorch" published: 2026-07-23T17:23:23.401Z updated: 2026-07-24T08:18:58.006Z tags: ["pytorch"] reading_time: 9 upvotes: 1 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Helion on TPU: Towards Hardware Heterogeneous Kernel Authoring – PyTorch **[PyTorch](https://daily.dev/sources/pytorch)** · 9 min read · 1 upvotes · 0 comments ## Summary Helion is PyTorch's high-level DSL for writing performance-portable ML kernels. A new TPU backend compiles Helion kernels to Pallas (Google's low-level TPU DSL), enabling PyTorch-style kernel authoring for TPUs without deep Pallas expertise. On a flash attention workload, the Helion-generated kernel achieves 838 TFLOPs (~79% MFU) on TPU v7. The key innovation is an autotuner that selects between two pipelining strategies — `emit_pipeline` (memory-efficient, scales to long sequences) and `unroll` (pre-fetches K/V into VMEM, eliminates compute bubbles but uses more memory) — based on input shape. Across a broader benchmark suite, Helion achieves a geometric mean 1.55x speedup over TorchTPU eager and 1.12x over torch.compile with XLA, with the largest gains on fusion-heavy kernels like attention that XLA struggles to optimize automatically. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Helion: A High-Level DSL for Performant and Portable ML Kernels – PyTorch](https://daily.dev/posts/helion-a-high-level-dsl-for-performant-and-portable-ml-kernels-pytorch-przi31los) · PyTorch · 0 upvotes · 0 comments - [Portable Paged Attention in Helion – PyTorch](https://daily.dev/posts/portable-paged-attention-in-helion-pytorch-p3relozri) · PyTorch · 0 upvotes · 0 comments - [From 200 lines to 15: How Helion is rewriting the rules of GPU programming](https://daily.dev/posts/from-200-lines-to-15-how-helion-is-rewriting-the-rules-of-gpu-programming-ewda7l8wq) · Red Hat Developer · 0 upvotes · 0 comments --- Tags: [#pytorch](https://daily.dev/tags/pytorch) [View this post on daily.dev](https://daily.dev/posts/helion-on-tpu-towards-hardware-heterogeneous-kernel-authoring-pytorch-uvlidlhmw)