---
title: "How to Evaluate Live & Voice Agents in ADK"
url: https://daily.dev/posts/how-to-evaluate-live-voice-agents-in-adk-mx6s58g3a
source_url: https://developers.googleblog.com/how-to-evaluate-live-voice-agents-in-adk
type: article
source: "Google Developers"
published: 2026-08-24T18:13:37.995Z
updated: 2026-08-24T18:14:04.369Z
tags: ["llm", "cicd", "google-gemini", "voice-ai"]
reading_time: 6
upvotes: 3
comments: 1
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# How to Evaluate Live & Voice Agents in ADK

**[Google Developers](https://daily.dev/sources/googledevs)** · 6 min read · 3 upvotes · 1 comments

## Summary

Google's Agent Development Kit (ADK) now supports native live evaluation for voice-based agents, letting developers drive a live agent with a simulated audio user, score multi-turn spoken conversations with rubric-based judging, and run the same eval loop used for text agents. The walkthrough builds a three-stage graph-based live workflow (greeter, DOB verifier, goals agent) running on gemini-live-2.5-flash-native-audio, shows how to author conversation-scenario and fixed-conversation eval cases, configure a user simulator with Gemini TTS voices, run evals via CLI or programmatically through AgentEvaluator for CI/CD, and inspect results with playable audio transcripts in ADK Web.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://developers.googleblog.com/how-to-evaluate-live-voice-agents-in-adk>

## Questions this post answers

### How do I evaluate a live voice agent built with Google ADK?

Google ADK now includes native live evaluation, letting a simulated audio user speak turns to a live voice agent and score the spoken replies within the same eval loop used for text agents. Test cases can be conversation scenarios (simulator improvises turns from a goal and persona) or fixed conversations (scripted turns), run via CLI with adk eval or programmatically through AgentEvaluator for CI/CD.

_daily.dev surfaces workflow guides like this for teams building CI/CD pipelines around voice agent testing._

### What is the user_persona field for in an ADK conversation_scenario eval case?

The user_persona field shapes how the simulated user communicates during a live agent evaluation in Google ADK. For example, the built-in NOVICE persona tells the simulator to share only high-level goals and wait for the agent to ask for specifics, testing how well the agent drives the conversation. Personas are prompt-driven, so custom personas can be added.

_Developers designing agent test suites can track ADK eval features like this on daily.dev._

### How does Google ADK synthesize speech for simulated users in voice agent testing?

Google ADK synthesizes each simulated user turn to speech using the Gemini TTS voice specified in the test_config.json under user_simulator_config, with the llm_audio type. The model field controls the simulated user's turn-taking logic while audio_model handles speech synthesis, and voice_name plus language_code can be adjusted to test agent performance against different voices and accents.

_daily.dev helps engineers stay current on Gemini TTS and ADK integration details for voice testing setups._

## Community discussion

Top comments from developers on daily.dev.

**@kartiknvj** · 0 upvotes

> The inline audio playback next to the transcript is the piece I wish every voice eval tool had, because reading a transcript will not tell you the agent talked over the user or dragged the pause. I have found improvised scenarios catch far more real bugs than fixed conversations, but only if the persona actually pushes back instead of politely accepting whatever the agent says. Are the natural language rubrics scored by a judge model, and if so how are you calibrating drift on it over time?

## Similar posts on daily.dev

- [Announcing User Simulation in ADK Evaluation](https://daily.dev/posts/announcing-user-simulation-in-adk-evaluation-hgcgnjkrw) · Google Developers · 0 upvotes · 0 comments
- [Announcing User Simulation in ADK Evaluation](https://daily.dev/posts/announcing-user-simulation-in-adk-evaluation-pfqodp6wn) · Google Developers · 0 upvotes · 0 comments

---

Tags: [#llm](https://daily.dev/tags/llm), [#cicd](https://daily.dev/tags/cicd), [#google-gemini](https://daily.dev/tags/google-gemini), [#voice-ai](https://daily.dev/tags/voice-ai)

[View this post on daily.dev](https://daily.dev/posts/how-to-evaluate-live-voice-agents-in-adk-mx6s58g3a)
