The true cost of saying "Hi" to an AI agent
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
Token prices are nearly negligible when using AI agents — the real cost is developer waiting time. A benchmark of 14 LLMs across 210 agentic trials using three prompts ('Hi', 'commit', 'WTF') reveals that latency, not API spend, dominates the total cost. Ambiguous prompts cause models to spiral into dozens of unnecessary tool calls: Claude Sonnet averaged 24 tool calls and 49 seconds just to respond to 'Hi', while some models failed entirely. A clear, specific prompt like 'commit' resolved cleanly every time across all models. At a $120K/year developer salary, each second of waiting costs $0.016 — making waiting 20x more expensive than tokens on the cheapest model. The takeaway: prompt clarity is the most impactful cost optimization available today, and model speed matters far more than token pricing for agentic workflows.
