New
AI & RoboticsMore in AI & Robotics→
Cloudflare Replaces Blanket AI Bot Block with Granular Controls for Search, Training, and Agent Crawlers
Key Takeaways
- Cloudflare replaces blanket AI bot block with granular controls for Search, Training, and Agent categories.
- Starting September 15, 2026, Training and Agent bots blocked by default on ad-supported pages; Search crawlers allowed.
- Multi-purpose crawlers follow strictest rule; free plan users get new controls.
- Cloudflare launches BotBase, a searchable enterprise bot database.
DE
DT Editorial Team··via the-decoder.com