Learn how to run real device mobile tests using Claude AI and Kobaton. We break down how to turn AI-generated Appium scripts into real production value.

Try the Kobaton Claude integration in your real workflow for 3 months. Use code TESTGUILD3 here: https://links.testguild.com/Kobiton

In this episode, we break down what actually works when it comes to AI-powered mobile test automation, especially when running tests on real devices (not simulators) directly from Claude.

You’ll learn:

How teams are generating and running Appium tests using natural language in minutes.

Why AI-generated tests often fail—and how to avoid costly false positives.

The real impact of AI on test automation roles and responsibilities.

How real device testing exposes issues AI alone can’t catch.

Practical ways to reduce test maintenance while increasing coverage.

We also explore a major shift happening right now:
AI is making it easier to create tests—but dramatically increasing the volume of code and risk that needs to be validated. That means one thing: Testing isn’t going away—it’s becoming more critical than ever.

If you’re a QA engineer, automation engineer, or DevOps leader trying to keep up with AI-driven development, this episode will give you a clear, practical perspective on what to focus on next.

Video Chapters:
00:00 - Building an Android App & Appium Script in 15 Minutes
00:23 - The Shift to AI-Generated Tests on Real Devices
02:53 - Managing Legacy Appium Scripts with Claude Code
07:47 - Demo: Running Cloud-Based Real Device Tests via Claude MCP
18:46 - Testing Canvas Apps and PDFs without Locators
25:52 - Human Governance and the Future of Testing Roles
30:20 - Try Kobaton (Promo Code)

📑 Get 10 quick & actionable test automation tips I've compiled after interviewing over 500+ testing thought leaders👇
https://testguild.com/10tips
------------------------------------------------------------------

🔎 Find out your automation testing score by taking the simple 6-Step Automation Testing Assessment Quiz👇
https://testguild.com/score

This assessment is designed to inform you about what areas of your automation testing SDLC you need to improve on 📊

------------------------------------------------------------------
Access more BONUS content from TestGuild:

✅ Mini-Courses / Tutorials: https://testguild.com/training-courses/
✅ Training Sessions: https://testguild.com/webinars/
✅ Automation | DevOps | Security Testing Podcasts: https://testguild.com/podcasts/

------------------------------------------------------------------
📚 Get My “Read 1-Page/day” Automation Awesomeness Book Now👇
https://testguild.com/automationbook/

Join the Test Guild Family
===============================
✋ - LinkedIn: https://testguild.com/linkedin
X - Twitter: https://twitter.com/joecolantonio
👥 - Facebook: https://www.facebook.com/testguilds
🫶- AutomationGuild: http://automationguild.com
===============================

Automation Testing with Joe Colantonio

Kobiton launched a Claude MCP plugin that lets developers create, debug, and run mobile tests on real devices using natural language inside Claude or other AI coding tools. The podcast covers a live demo showing how Claude can run Appium scripts on real devices in Kobiton's cloud, automatically detect bugs (like keyboard overlap on small screens), and propose fixes. Topics include AI-generated test quality risks (false positives, tests that miss the point), token cost optimization via local models, natural language element selectors for canvas/PDF apps, and the evolving role of QA engineers as AI accelerates code output 10x.

How to Run Real Device Mobile Tests with Claude AI