---
title: "The Third Bit: Twelve Ways to Be Wrong About AI-Assisted Coding"
url: https://daily.dev/posts/the-third-bit-twelve-ways-to-be-wrong-about-ai-assisted-coding-xxsvabv2z
source_url: https://third-bit.com/2026/05/20/twelve-ways-to-be-wrong
type: article
source: "Lobsters"
published: 2026-05-21T13:14:38.912Z
updated: 2026-05-21T13:15:04.518Z
tags: ["github", "productivity", "ai-coding"]
reading_time: 11
upvotes: 1
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# The Third Bit: Twelve Ways to Be Wrong About AI-Assisted Coding

**[Lobsters](https://daily.dev/sources/lobsters)** · 11 min read · 1 upvotes · 0 comments

## Summary

A critical examination of twelve common methodological flaws in studies and claims about AI coding tool productivity. Covers problems including proxy metrics like lines of code, artificial task timing, lack of control groups, self-report bias (Hawthorne effect, novelty effect, social desirability), Goodhart's Law applied to commit counts, measuring only code generation speed while ignoring review burden and security debt, treating adoption rate or suggestion acceptance rate as success metrics, selection bias from volunteer studies, individual vs. system-level measurement, short novelty-period studies, and comparing AI to no-tool baselines rather than existing developer alternatives. Each flaw is backed by academic citations including studies showing AI tools can increase task completion time, introduce security vulnerabilities, and raise code complexity over time.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://third-bit.com/2026/05/20/twelve-ways-to-be-wrong>

---

Tags: [#github](https://daily.dev/tags/github), [#productivity](https://daily.dev/tags/productivity), [#ai-coding](https://daily.dev/tags/ai-coding)

[View this post on daily.dev](https://daily.dev/posts/the-third-bit-twelve-ways-to-be-wrong-about-ai-assisted-coding-xxsvabv2z)