--- title: "Everyone building a software factory wants the same proof" url: https://daily.dev/posts/everyone-building-a-software-factory-wants-the-same-proof-tuygipxpv source_url: https://devinterrupted.substack.com/p/everyone-building-a-software-factory type: article source: "Dev Interrupted" published: 2026-08-13T20:37:39.545Z updated: 2026-08-14T10:11:56.139Z tags: ["ai-agents", "cicd", "leadership", "code-review"] reading_time: 12 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Everyone building a software factory wants the same proof **[Dev Interrupted](https://daily.dev/sources/devinterrupted)** · 12 min read · 0 upvotes · 0 comments ## Summary Engineering leaders from HumanLayer, Warp, AWS and Asana discuss how autonomous 'software factories' - pipelines where AI agents triage, spec, implement, review and ship code - actually work in practice. All agree that humans must retain ownership and accountability even when agents open pull requests, and that code review, not code generation, has become the real bottleneck. LinearB's 2026 mid-year benchmarks show agentic pull requests merge at only 37% in weaker organizations versus 79% in stronger ones, with AI code review coverage ranging from 8% to 57% across the community. Dex Horthy's SlopCodeBench experiments found unreviewed AI output had over 11 times more 'slop' triggers per thousand lines of code than reviewed code, leading him to conclude current models can't be trusted to run fully autonomously without human steering. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How much more likely are AI-reviewed pull requests to merge quickly compared to human-only reviewed ones? At the top-performing organizations, pull requests reviewed by AI merge at the same 92% rate as those reviewed only by humans, but the gap widens further down: AI-reviewed PRs merge at 86% versus 79% for human-only review in the weakest organizations. AI review coverage itself is uneven, ranging from 57% of PRs at top organizations down to just 8% at the bottom, according to LinearB's 2026 mid-year benchmarks covering 2.7 million pull requests. _Teams weighing AI code review adoption track benchmark data like this on daily.dev._ ### Can current AI coding agents run unsupervised without a human reviewing their code? No, according to Dex Horthy's testing with SlopCodeBench, a long-horizon benchmark that withholds requirements upfront so agents must keep adapting. Running three Claude models through a 17-checkpoint subset, he found over 11 times more 'slop' triggers per thousand lines of code in unreviewed lights-off output compared to HumanLayer's own reviewed TypeScript codebase, concluding models still need steering. _Developers evaluating how far to trust autonomous coding agents follow findings like this on daily.dev._ ### What is the merge rate difference between AI agent-generated pull requests and regular pull requests? Agentic pull requests merge within 30 days at only 37% in the lowest-performing organizations, compared to 81% for all pull requests in those same organizations; at the strongest organizations agentic PRs merge at 79% versus 90% for all PRs. This gap, drawn from LinearB's 2026 mid-year benchmarks of 2.7 million pull requests across 253 organizations, shows agent-authored work stalling more than human work even within the same teams. _Engineering leaders benchmarking their own AI adoption compare stats like these on daily.dev._ ## Similar posts on daily.dev - [Agentic Code Review](https://daily.dev/posts/agentic-code-review-0ue8fcsa1) · Addy Osmani · 146 upvotes · 13 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#cicd](https://daily.dev/tags/cicd), [#leadership](https://daily.dev/tags/leadership), [#code-review](https://daily.dev/tags/code-review) [View this post on daily.dev](https://daily.dev/posts/everyone-building-a-software-factory-wants-the-same-proof-tuygipxpv)