Cloudflare is launching two initiatives to address the broken economics of AI-powered search. First, a research program that uses Cloudflare's network signals (content freshness, traffic patterns) to help AI answer engines surface higher-quality content while reducing unnecessary re-crawling — over 50% of good-bot crawl traffic currently re-fetches unchanged pages. Second, an evolution of their Pay Per Crawl product toward Pay Per Use, where content creators are compensated when their work actually appears in AI search results rather than just when it's crawled. Early experiments are running with Ceramic.ai (pay-per-query model) and You.com (on-demand premium content access). The goal is to rebuild the web's content discovery bargain for the agentic era: AI companies get fresher, better-grounded answers, and creators get paid for the value they deliver.

9m read timeFrom blog.cloudflare.com
Post cover image
Table of contents
Rebuilding the bargainMaking search smarterFrom Pay Per Crawl to Pay Per UseThe headline we want to earn
190 Impressions