---
title: "We Ran 250 AI Agent Evals to Find Out if Skills Beat Docs. The Answer Is More Complicated Than We Expected"
url: https://daily.dev/posts/we-ran-250-ai-agent-evals-to-find-out-if-skills-beat-docs-the-answer-is-more-complicated-than-we-ex-uquqegqzg
source_url: https://www.wix.engineering/post/we-ran-250-ai-agent-evals-to-find-out-if-skills-beat-docs-the-answer-is-more-complicated-than-we-ex
type: article
source: "Wix Engineering"
published: 2026-05-06T11:24:44.550Z
updated: 2026-05-06T11:25:10.486Z
tags: ["llm", "ai-agents", "nocode", "mcp"]
reading_time: 8
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# We Ran 250 AI Agent Evals to Find Out if Skills Beat Docs. The Answer Is More Complicated Than We Expected

**[Wix Engineering](https://daily.dev/sources/wix_eng)** · 8 min read · 0 upvotes · 0 comments

## Summary

Wix Engineering ran 250 controlled evaluations comparing AI agent performance using standard docs, agent-optimized docs, and purpose-built skills. Key findings: optimizing docs alone improved CLI task completion from 67% to 87% while cutting token usage by 35%. Skills outperformed docs only when accurate and well-maintained, but small errors (misaligned scaffolding, broken code snippets) erased their advantage entirely. For REST API tasks, docs-optimized runs were 31% faster despite skills using fewer tokens, due to MCP tool fragmentation causing more sequential calls. An unexpected finding: skills made agents less exploratory, constraining solution space. The recommended framework treats agent-optimized docs as the backbone and skills as a caching layer for common tasks, with regular evals to detect drift.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://www.wix.engineering/post/we-ran-250-ai-agent-evals-to-find-out-if-skills-beat-docs-the-answer-is-more-complicated-than-we-ex>

## Similar posts on daily.dev

- [AGENTS.md outperforms skills in our agent evals](https://daily.dev/posts/agents-md-outperforms-skills-in-our-agent-evals-9b0bolfqt) · Hacker News · 20 upvotes · 0 comments

---

Tags: [#llm](https://daily.dev/tags/llm), [#ai-agents](https://daily.dev/tags/ai-agents), [#nocode](https://daily.dev/tags/nocode), [#mcp](https://daily.dev/tags/mcp)

[View this post on daily.dev](https://daily.dev/posts/we-ran-250-ai-agent-evals-to-find-out-if-skills-beat-docs-the-answer-is-more-complicated-than-we-ex-uquqegqzg)