A personal blog and wiki operator explains an error page shown to visitors flagged by anti-crawler defenses that block suspicious or outdated browser User-Agent strings, particularly old Chrome versions widely used by high-volume crawlers (some scraping data for LLM training). The page details known false positives: Inoreader and Feedly feed fetchers mistakenly using fake old-browser User-Agents, Vivaldi users needing to disable Chrome User-Agent brand masking, and archive.today/archive.ph crawlers using suspicious old Chrome UAs and spoofed reverse DNS. Users are advised to use archive.org instead and to contact the site owner if incorrectly blocked.

3m read timeFrom utcc.utoronto.ca
Post cover image
Table of contents
A special note to people using Inoreader (the feed reader)A special note to people using Feedly (the feed reader)A special note for people using VivaldiA special note for people using archive.*
184 Impressions