--- title: "Our AI Code Review Workflow, 7 Months Later" url: https://daily.dev/posts/our-ai-code-review-workflow-7-months-later-toxgr8mk3 source_url: https://spin.atomicobject.com/ai-code-review-workflow-7 type: article source: "Atomic Spin" published: 2026-08-18T12:02:49.568Z updated: 2026-08-18T12:04:28.070Z tags: ["ai-agents", "cicd", "github-actions", "prompt-engineering", "code-review"] reading_time: 6 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Our AI Code Review Workflow, 7 Months Later **[Atomic Spin](https://daily.dev/sources/atomicobject)** · 6 min read · 0 upvotes · 0 comments ## Summary A team shares a seven-month update on their homegrown AI code review workflow, describing a shift toward agent-written code with heavy reliance on AI review to catch missed edge cases. They dropped third-party review tools (like Sentry's AI review beta) in favor of a custom GitHub Action reviewer, made it a blocking merge gate requiring human override with justification, and tackled inconsistency across runs by feeding the bot PR descriptions, prior review comments, and author replies. They also added a local pre-push review step using a Claude skill, and note that switching the underlying model from a hosted commercial one to a self-hosted open-weights model degraded output quality, requiring prompt re-tuning. The overall takeaway: the system only works because it's continuously maintained. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### Why does my AI code review bot give different findings every time I run it on the same pull request? Inconsistent AI review findings typically stem from each run starting cold with only the diff and no memory of prior context. Feeding the model the PR description, its own earlier review comments, and the author's replies (including override justifications) helps it build on previous findings instead of re-deriving everything from scratch, reducing new must-fixes appearing on unchanged code. _Teams debugging flaky AI review output can find similar workflow write-ups on daily.dev._ ### Does switching from a hosted commercial LLM to a self-hosted open-weights model affect AI code review quality? Yes, switching the model behind an AI code review pipeline from a hosted commercial model to a self-hosted open-weights model can produce a noticeable step down in quality, with less consistently formatted output and more scattered findings. Prompts tuned for one model do not carry over cleanly to another and require significant rewriting to match the new model's behavior. _Anyone weighing hosted versus self-hosted models for coding workflows can track these trade-offs on daily.dev._ ### How can I make an AI code review bot block pull request merges safely? A review bot can be turned into a blocking gate by having it post a single comment listing must-fix and should-fix findings, checking for must-fixes with a simple regex, and requesting changes on the PR when any are found. Authors must then address the issues or override the review with a specific label and a justification comment, alongside a required human approver. _Developers building enforceable AI review gates can follow similar setups on daily.dev._ ## Similar posts on daily.dev - [Agentic Code Review](https://daily.dev/posts/agentic-code-review-0ue8fcsa1) · Addy Osmani · 146 upvotes · 13 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#cicd](https://daily.dev/tags/cicd), [#github-actions](https://daily.dev/tags/github-actions), [#prompt-engineering](https://daily.dev/tags/prompt-engineering), [#code-review](https://daily.dev/tags/code-review) [View this post on daily.dev](https://daily.dev/posts/our-ai-code-review-workflow-7-months-later-toxgr8mk3)