<!-- mobian-agent-page publisher="dailydev" canonical="https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6" -->

---
title: AI Edge Torch: High Performance Inference of Pytorch...
description: Google AI Edge Torch is a new offering that provides a direct path from PyTorch to the TensorFlow Lite runtime for high-performance inference of PyTorch models...
canonical: https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6
twitter:card: summary_large_image
twitter:site: @dailydotdev
og:type: website
og:site_name: daily.dev
og:title: AI Edge Torch: High Performance Inference of Pytorch Models on Mobile Devices | daily.dev
og:description: Google AI Edge Torch is a new offering that provides a direct path from PyTorch to the TensorFlow Lite runtime for high-performance inference of PyTorch models...
og:url: https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6
og:image: https://api.daily.dev/og/posts/TDv6fipX6.png
og:image:alt: AI Edge Torch: High Performance Inference of Pytorch Models on Mobile Devices
og:image:width: 1200
og:image:height: 630
og:locale: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# AI Edge Torch: High Performance Inference of Pytorch Models on Mobile Devices

**[Google Developers](https://daily.dev/sources/googledevs)** · 3 min read · 3 upvotes · 0 comments

## Summary

Google AI Edge Torch is a new offering that provides a direct path from PyTorch to the TensorFlow Lite runtime for high-performance inference of PyTorch models on mobile devices. It offers easy conversion, great model coverage, and CPU performance. The release includes coverage and performance improvements over existing workflows, early adoption by Shopify for on-device background removal, and partnerships with hardware companies for improved performance and coverage. Qualcomm has also released a new TensorFlow Lite delegate that provides significant speedups using DSP and neural processing units.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://developers.googleblog.com/en/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices/>

---

Tags: [#ai](https://daily.dev/tags/ai), [#tensorflow](https://daily.dev/tags/tensorflow), [#pytorch](https://daily.dev/tags/pytorch), [#edge-computing](https://daily.dev/tags/edge-computing)

[View this post on daily.dev](https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6)

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]}
{"@context":"https://schema.org","@type":"TechArticle","headline":"AI Edge Torch: High Performance Inference of Pytorch Models on Mobile Devices","url":"https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6"},"datePublished":"2024-05-14T20:36:21.441Z","dateModified":"2024-05-14T20:36:20.467Z","description":"Google AI Edge Torch is a new offering that provides a direct path from PyTorch to the TensorFlow Lite runtime for high-performance inference of PyTorch models...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/04ebcbeb48d4e8bc9f526b36f187453d?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/04ebcbeb48d4e8bc9f526b36f187453d?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Google Developers","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Google Developers","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/ea4bbded4e7f45ccb82e121a3156535f","url":"https://daily.dev/sources/googledevs"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/ai-edge-torch-high-performance-inference-of-pytorch-models-on-mobile-devices-tdv6fipx6","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":3},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai,tensorflow,pytorch,edge-computing","timeRequired":"PT3M"}
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Google Developers","item":"https://daily.dev/sources/googledevs"},{"@type":"ListItem","position":3,"name":"AI Edge Torch: High Performance Inference of Pytorch Models on Mobile Devices"}]}
```

