TechCloudflare Blog49m ago
Say it once: introducing Bot Preference SynC
TL;DRCloudflare syncs robots.txt with AI bot policies automatically.
Why it matters: Eliminates manual file updates when controlling bot access across search, agents, and training uses.
Cloudflare's new Bot Preference Sync automatically aligns your robots.txt file with your AI bot policies for Search, Agent, and Training. Easily manage which bots access your content without maintaining static files.
Read full articleSource: Cloudflare Blog · Opens in new tab