---
title: "Benchmark LLMs on-device with AI Edge Portal"
url: https://daily.dev/posts/benchmark-llms-on-device-with-ai-edge-portal-b3cgdz9pt
source_url: https://cloud.google.com/blog/products/ai-machine-learning/benchmark-llms-on-device-with-ai-edge-portal
type: article
source: "Google Cloud"
published: 2026-05-20T16:01:11.550Z
updated: 2026-05-20T16:01:35.388Z
tags: ["android", "llm", "local-ai"]
reading_time: 4
upvotes: 1
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Benchmark LLMs on-device with AI Edge Portal

**[Google Cloud](https://daily.dev/sources/gcp)** · 4 min read · 1 upvotes · 0 comments

## Summary

Google AI Edge Portal now supports benchmarking and debugging on-device LLMs across a physical lab of over 120 Android devices. Developers can measure key metrics like initialization time, prefill speed, decode speed, and peak memory usage for LiteRT-LM format models on CPU and GPU backends. A newly integrated Model Explorer tool enables graph visualization, side-by-side model comparison, and per-layer analysis to help identify and fix conversion, quantization, and optimization issues. The feature is currently in private preview for allowlisted Google Cloud customers at no charge.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://cloud.google.com/blog/products/ai-machine-learning/benchmark-llms-on-device-with-ai-edge-portal>

## Similar posts on daily.dev

- [Elevating AI-assisted Android development and improving LLMs with Android Bench](https://daily.dev/posts/elevating-ai-assisted-android-development-and-improving-llms-with-android-bench-vcrh8h3bs) · Android Developers Blog · 0 upvotes · 0 comments
- [On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM](https://daily.dev/posts/on-device-genai-in-chrome-chromebook-plus-and-pixel-watch-with-litert-lm-ixbxtp6dj) · Google Developers · 2 upvotes · 0 comments

---

Tags: [#android](https://daily.dev/tags/android), [#llm](https://daily.dev/tags/llm), [#local-ai](https://daily.dev/tags/local-ai)

[View this post on daily.dev](https://daily.dev/posts/benchmark-llms-on-device-with-ai-edge-portal-b3cgdz9pt)