--- title: Cloudflare Extends AI Search to Make it Easier for... description: Cloudflare has expanded AI Search, its built-in retrieval service that gives AI agents and applications a ready-made search engine over custom data. The... canonical: https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Cloudflare Extends AI Search to Make it Easier for Agents and Developers to Search Custom Data | daily.dev og:description: Cloudflare has expanded AI Search, its built-in retrieval service that gives AI agents and applications a ready-made search engine over custom data. The... og:url: https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne og:image: https://api.daily.dev/og/posts/cP63j3xNE.png og:image:alt: Cloudflare Extends AI Search to Make it Easier for Agents and Developers to Search Custom Data og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Cloudflare Extends AI Search to Make it Easier for Agents and Developers to Search Custom Data **[InfoQ](https://daily.dev/sources/infoq)** · 3 min read · 0 upvotes · 0 comments ## Summary Cloudflare has expanded AI Search, its built-in retrieval service that gives AI agents and applications a ready-made search engine over custom data. The service bundles crawling, parsing, embedding, vector storage, and search API into a single pipeline, now supporting a sitemap-free 'discover' mode, a single public endpoint for querying across multiple sources, and integration with a Worker or public /mcp and /search endpoints. It is available across Cloudflare-managed services like its API docs, Astro, Vite, Hono, and Replicate, and integrates with the EmDash open-source CMS via a plugin. Pricing will charge for answer generation and query rewriting once generally available, while embedding and re-ranking stay free with default models; the service is currently free during its beta period. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do I create a Cloudflare AI Search instance from the command line? Use the wrangler CLI with the ai-search create command, specifying a name, namespace, source URL, crawler type, and parse type, for example: npx wrangler ai-search create cloudflare-community --namespace dev-stack --source https://community.cloudflare.com --type web-crawler --parse-type discover. This single command handles crawling, ingestion, embedding, and retrieval automatically. _daily.dev surfaces practical setup guides for developers wiring up agent search pipelines._ ### Does Cloudflare AI Search require a sitemap to index a website? No, a sitemap is no longer required because AI Search now supports a 'discover' mode that automatically finds pages on a site without one. Previously, each indexed website needed a published sitemap for Cloudflare AI Search to crawl it. _Track updates like this on daily.dev to stay ahead when your search or crawling setup changes._ ### How is Cloudflare AI Search priced during its beta period? Cloudflare AI Search is free to use during the beta period. Once it reaches general availability, embedding and re-ranking will remain free when using default models or select Workers AI catalog models, while answer generation and query rewriting will be billed based on model usage. _daily.dev helps developers comparing AI infrastructure costs keep tabs on pricing changes like this._ ## Similar posts on daily.dev - [Cloudflare AI Search: give your agents a search engine for your data](https://daily.dev/posts/cloudflare-ai-search-give-your-agents-a-search-engine-for-your-data-ctstzert3) · Cloudflare · 1 upvotes · 0 comments - [AI Search: the search primitive for your agents](https://daily.dev/posts/ai-search-the-search-primitive-for-your-agents-esbieslcq) · Cloudflare · 1 upvotes · 0 comments - [An AI Index for all our customers](https://daily.dev/posts/an-ai-index-for-all-our-customers-zaklkvghw) · Cloudflare · 0 upvotes · 0 comments - [Making AI search smarter](https://daily.dev/posts/making-ai-search-smarter-vdumwudvn) · Cloudflare · 0 upvotes · 0 comments - [Cloudflare and OpenAI pilot to make AI search fresher](https://daily.dev/posts/cloudflare-and-openai-pilot-to-make-ai-search-fresher-nodwmgakn) · The Next Web · 0 upvotes · 0 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#cloudflare](https://daily.dev/tags/cloudflare), [#vector-search](https://daily.dev/tags/vector-search), [#ai-search](https://daily.dev/tags/ai-search) [View this post on daily.dev](https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Cloudflare Extends AI Search to Make it Easier for Agents and Developers to Search Custom Data","url":"https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne"},"datePublished":"2026-08-30T19:03:23.887Z","dateModified":"2026-08-30T19:03:47.573Z","description":"Cloudflare has expanded AI Search, its built-in retrieval service that gives AI agents and applications a ready-made search engine over custom data. The...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/805807457f24812dd71320d1988b926b?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/805807457f24812dd71320d1988b926b?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"InfoQ","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"InfoQ","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/afc3bced3e1e4b188dd9127017a60e0c","url":"https://daily.dev/sources/infoq"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai-agents,cloudflare,vector-search,ai-search","timeRequired":"PT3M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"InfoQ","item":"https://daily.dev/sources/infoq"},{"@type":"ListItem","position":3,"name":"Cloudflare Extends AI Search to Make it Easier for Agents and Developers to Search Custom Data"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/cloudflare-extends-ai-search-to-make-it-easier-for-agents-and-developers-to-search-custom-data-cp63j3xne#faq","mainEntity":[{"@type":"Question","name":"How do I create a Cloudflare AI Search instance from the command line?","acceptedAnswer":{"@type":"Answer","text":"Use the wrangler CLI with the ai-search create command, specifying a name, namespace, source URL, crawler type, and parse type, for example: npx wrangler ai-search create cloudflare-community --namespace dev-stack --source https://community.cloudflare.com --type web-crawler --parse-type discover. This single command handles crawling, ingestion, embedding, and retrieval automatically. daily.dev surfaces practical setup guides for developers wiring up agent search pipelines."}},{"@type":"Question","name":"Does Cloudflare AI Search require a sitemap to index a website?","acceptedAnswer":{"@type":"Answer","text":"No, a sitemap is no longer required because AI Search now supports a 'discover' mode that automatically finds pages on a site without one. Previously, each indexed website needed a published sitemap for Cloudflare AI Search to crawl it. Track updates like this on daily.dev to stay ahead when your search or crawling setup changes."}},{"@type":"Question","name":"How is Cloudflare AI Search priced during its beta period?","acceptedAnswer":{"@type":"Answer","text":"Cloudflare AI Search is free to use during the beta period. Once it reaches general availability, embedding and re-ranking will remain free when using default models or select Workers AI catalog models, while answer generation and query rewriting will be billed based on model usage. daily.dev helps developers comparing AI infrastructure costs keep tabs on pricing changes like this."}}]} ```