Cloudflare Debuts Markdown for Agents and Content Signals to Guide AI Crawlers

Wait 5 sec.

Cloudflare has introduced “Markdown for Agents,” a feature that lets AI crawlers request Markdown versions of web pages. The company pairs the feature with a proposed “Content Signals” mechanism that lets publishers declare whether their content may be used for AI training, search indexing or inference. By Matt Foster