--- title: Google, Microsoft, OpenAI and Anthropic back one AI... description: Google, Microsoft, OpenAI and Anthropic will honor a single shared robots.txt signal letting websites opt out of AI training. Sites add a group using a new... canonical: https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Google, Microsoft, OpenAI and Anthropic back one AI training opt-out | daily.dev og:description: Google, Microsoft, OpenAI and Anthropic will honor a single shared robots.txt signal letting websites opt out of AI training. Sites add a group using a new... og:url: https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7 og:image: https://api.daily.dev/og/posts/Q4YCvu3I7.png og:image:alt: Google, Microsoft, OpenAI and Anthropic back one AI training opt-out og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Google, Microsoft, OpenAI and Anthropic back one AI training opt-out **[The Next Web](https://daily.dev/sources/tnw)** · 4 min read · 0 upvotes · 0 comments ## Summary Google, Microsoft, OpenAI and Anthropic will honor a single shared robots.txt signal letting websites opt out of AI training. Sites add a group using a new policy token, __usage_ai-training, listing paths to exclude. The draft comes from Anthropic's Kevin Kelley via an individual IETF submission with no formal standards status. OpenAI plans support in coming months, Microsoft starts February 1, 2027, replacing its NoArchive and NoCache tags, and Google targets early 2027. The signal states a preference, not a crawling order, and private agreements can override it. Meta's communications head voiced support but did not commit to honoring it. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How do I block my website content from AI training using robots.txt? Add a new robots.txt group using the policy token __usage_ai-training, then list the paths you don't want used for AI training. This comes from an IETF draft by Anthropic's Kevin Kelley, and Google, Microsoft, and OpenAI have announced support for it. A site with no such group has expressed no preference, since existing rules for all crawlers don't count as an opt-out. _daily.dev helps developers track evolving robots.txt and AI-crawler standards as they roll out._ ### When will Google and Microsoft start honoring the new AI training opt-out signal in robots.txt? Microsoft will honor the new preferences starting February 1, 2027, replacing the NoArchive and NoCache tags it has used since 2023. Google aims to support the signal in 2027, with its crawler documentation specifying early 2027. OpenAI said it plans to implement the signal in the coming months, while existing controls like GPTBot continue to apply in the meantime. _site operators planning AI-crawler policy can follow these rollout dates on daily.dev._ ### Does blocking AI training in robots.txt also stop my site from being used to ground AI-generated answers? No, training opt-out and grounding are separate settings under Microsoft's approach. Microsoft is adding a distinct page-level grounding control, where blocking grounding keeps content out of live AI-answer lookups but significantly reduces visibility in AI-generated experiences, while not changing a page's ranking in Bing search results. Training and grounding preferences must be configured independently. _publishers weighing AI visibility tradeoffs can track these policy distinctions on daily.dev._ ## Similar posts on daily.dev - [Your site, your rules: new AI traffic options for all customers](https://daily.dev/posts/your-site-your-rules-new-ai-traffic-options-for-all-customers-zrn0fx6z7) · Cloudflare · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#google](https://daily.dev/tags/google), [#openai](https://daily.dev/tags/openai) [View this post on daily.dev](https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Google, Microsoft, OpenAI and Anthropic back one AI training opt-out","url":"https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7"},"datePublished":"2026-10-31T12:30:12.523Z","dateModified":"2026-10-31T13:58:30.657Z","description":"Google, Microsoft, OpenAI and Anthropic will honor a single shared robots.txt signal letting websites opt out of AI training. Sites add a group using a new...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/e37ced337db759f4743dfc3537eacfc6?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/e37ced337db759f4743dfc3537eacfc6?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"The Next Web","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"The Next Web","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/tnw","url":"https://daily.dev/sources/tnw"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,google,openai","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"The Next Web","item":"https://daily.dev/sources/tnw"},{"@type":"ListItem","position":3,"name":"Google, Microsoft, OpenAI and Anthropic back one AI training opt-out"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out-q4ycvu3i7#faq","mainEntity":[{"@type":"Question","name":"How do I block my website content from AI training using robots.txt?","acceptedAnswer":{"@type":"Answer","text":"Add a new robots.txt group using the policy token __usage_ai-training, then list the paths you don't want used for AI training. This comes from an IETF draft by Anthropic's Kevin Kelley, and Google, Microsoft, and OpenAI have announced support for it. A site with no such group has expressed no preference, since existing rules for all crawlers don't count as an opt-out. daily.dev helps developers track evolving robots.txt and AI-crawler standards as they roll out."}},{"@type":"Question","name":"When will Google and Microsoft start honoring the new AI training opt-out signal in robots.txt?","acceptedAnswer":{"@type":"Answer","text":"Microsoft will honor the new preferences starting February 1, 2027, replacing the NoArchive and NoCache tags it has used since 2023. Google aims to support the signal in 2027, with its crawler documentation specifying early 2027. OpenAI said it plans to implement the signal in the coming months, while existing controls like GPTBot continue to apply in the meantime. site operators planning AI-crawler policy can follow these rollout dates on daily.dev."}},{"@type":"Question","name":"Does blocking AI training in robots.txt also stop my site from being used to ground AI-generated answers?","acceptedAnswer":{"@type":"Answer","text":"No, training opt-out and grounding are separate settings under Microsoft's approach. Microsoft is adding a distinct page-level grounding control, where blocking grounding keeps content out of live AI-answer lookups but significantly reduces visibility in AI-generated experiences, while not changing a page's ranking in Bing search results. Training and grounding preferences must be configured independently. publishers weighing AI visibility tradeoffs can track these policy distinctions on daily.dev."}}]} ```