What changed

OpenAI says it aims to implement the voluntary robots.txt signal in the coming months; its existing crawler controls will continue to apply.

Source: OpenAI announcement on AI training preferences

Our analysis

Publisher’s view: keep a record of your current crawler rules and the purpose of each one. Review the eventual implementation details before changing them, and treat training preferences separately from search visibility.

Keep in mind

The announcement does not establish that the new signal is already implemented or that every AI provider will honor it.

Source: OpenAI announcement on AI training preferences

Sources & dates

Article updated: 2 Nov 2026

Editorial standards & corrections