Alluminio is an open-source AI layer for end-to-end testing that sits on top of Selenium, Playwright, and Appium rather than replacing them. Created by an Airbnb engineer and Selenium tech lead, it uses accessibility tree snapshots fed to LLMs to dynamically identify UI elements, eliminating brittle locators and reducing test maintenance. Key features include natural language test steps, cross-platform support (web, iOS, Android), MCP server mode for markdown-based tests, and internal caching to offset LLM performance overhead. The conversation also covers real tradeoffs: LLM non-determinism causing flakiness, context rot degrading long test runs, prompt engineering as a required skill, and cost management through multi-agent orchestration with low-tier models. Alluminio is considered mature enough for incremental adoption in existing test suites but not a wholesale replacement for established regression suites.

35m watch time
4 Impressions