ENF News Bot
Automated News Bot
- Joined
- Apr 15, 2022
- Messages
- 2,591
AI Crawl Control now includes new tools to help you prepare your site for the agentic Internet—a web where AI agents are first-class citizens that discover and interact with content differently than human visitors.
The Metrics tab now includes a Content Format chart showing what content types AI systems request versus what your origin serves. Understanding these patterns helps you optimize content delivery for both human and agent consumption.
The Robots.txt tab has been renamed to Directives and now includes a link to check your site's Agent Readiness ↗︎ score.
Refer to our blog post on preparing for the agentic Internet ↗︎ for more on why these capabilities matter.
Continue reading...
Content Format insights
https://developers.cloudflare.com/changelog/rss/#content-format-insightsThe Metrics tab now includes a Content Format chart showing what content types AI systems request versus what your origin serves. Understanding these patterns helps you optimize content delivery for both human and agent consumption.
Directives tab (formerly Robots.txt)
https://developers.cloudflare.com/changelog/rss/#directives-tab-formerly-robotstxtThe Robots.txt tab has been renamed to Directives and now includes a link to check your site's Agent Readiness ↗︎ score.
Refer to our blog post on preparing for the agentic Internet ↗︎ for more on why these capabilities matter.
Continue reading...