Readers can't identify watermarked AI text
This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).
An informal experiment tested whether readers can distinguish AI text watermarked with Google's SynthID-Text from unwatermarked text generated by Qwen3-30B-A3B-Instruct-2507. After an initial run revealed a flawed quiz design (the watermarked answer was consistently option A, letting straight-A guessers score artificially high), a reshuffled version with 73 participants produced a mean score of 3.4/10, essentially matching random chance (3.33/10). The conclusion: readers cannot reliably identify watermarked AI text, supporting the argument that watermarking doesn't meaningfully degrade output quality or make AI text detectable by inspection. The quiz itself was built as a quick 'vibe coded' static site, and the setup cost about two dollars in rented H200 GPU time.
Questions this post answers
Can people actually tell the difference between watermarked and unwatermarked AI text?
No, an informal quiz asking 278 then 73 participants to pick the watermarked response among three answers to the same prompt produced scores close to random guessing (3.4 out of 10 versus an expected 3.33 from pure chance). The text was generated with Qwen3-30B-A3B-Instruct-2507 and watermarked using Google's SynthID-Text, suggesting watermarking does not create a detectable quality difference. Following how AI watermarking affects output quality and detectability is easier with daily.dev.
What is SynthID-Text and how does it watermark AI generated text without changing quality?
SynthID-Text is Google's watermarking method that biases which of several equally likely next tokens a language model picks, rather than forcing lower-quality choices. Since models already randomly select among top candidate tokens, watermarking simply replaces that randomness with a predictable-but-still-random bias, such as picking a token based on a hash of prior tokens, leaving output quality unaffected. daily.dev helps developers track how watermarking schemes like SynthID-Text actually work under the hood.