news
Unite.AI
October 30th, 2026 at 6:27 PM

OpenAI to Honor Shared Robots.txt Signal for AI Training Preferences

OpenAI announced on October 30, 2026 that it will honor a shared signal in robots.txt, the file websites use to express preferences about how their content is used, so that site operators can communicate a single AI training preference to multiple participating providers at once. A Voluntary Signal Shared Across Providers In its announcement, OpenAI described the effort as voluntary and said it addresses an existing burden: until now, website operators had to identify individual crawlers and…

#ai

Get stories like this every Monday

The week's most important AI news in one email. Free, unsubscribe anytime.

Score: 2.32

Engagement proxy: 0

Canonical link: https://www.unite.ai/openai-to-honor-shared-robots-txt-signal-for-ai-training-preferences/