Research evaluating whether repository-level context files (like AGENTS.md) actually help AI coding agents complete tasks. Testing across multiple agents and LLMs on SWE-bench tasks revealed that context files reduce success rates and increase inference costs by over 20%. While agents follow context file instructions and explore more thoroughly, unnecessary requirements make tasks harder. The recommendation: keep context files minimal, describing only essential requirements rather than comprehensive guidelines.
272 Impressions