--- title: "Large Language Models On-Device with MediaPipe and TensorFlow Lite" url: https://daily.dev/posts/large-language-models-on-device-with-mediapipe-and-tensorflow-lite-hc09lki2r source_url: https://developers.googleblog.com/en/large-language-models-on-device-with-mediapipe-and-tensorflow-lite/ type: article source: "Google Developers" published: 2024-04-25T06:36:47.960Z updated: 2024-05-09T09:23:16.455Z tags: ["python", "tensorflow"] reading_time: 5 upvotes: 5 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Large Language Models On-Device with MediaPipe and TensorFlow Lite **[Google Developers](https://daily.dev/sources/googledevs)** · 5 min read · 5 upvotes · 0 comments ## Summary TensorFlow Lite and MediaPipe have released the experimental MediaPipe LLM Inference API, which allows Large Language Models (LLMs) to run fully on-device across platforms. This new capability streamlines on-device LLM integration for web developers and supports Web, Android, and iOS. The LLM Inference API can be used by converting model weights, including the SDK in your application, hosting the TensorFlow Lite Flatbuffer, and using the API to generate text responses from the model. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 0 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#python](https://daily.dev/tags/python), [#tensorflow](https://daily.dev/tags/tensorflow) [View this post on daily.dev](https://daily.dev/posts/large-language-models-on-device-with-mediapipe-and-tensorflow-lite-hc09lki2r)