Agentmap directive

Discover Agentmap is a line a publisher can add to robots.txt, of the form Agentmap: https://example.com/entries.json, that points a crawler at a source of Agentic Resource Discovery (ARD) entries as an alternative to relying solely on the well-known manifest path. It is defined in the ARD specification itself (v0.91, §5.1, 26 August 2026) as one of five discovery mechanisms alongside the well-known manifest, in-page JSON-LD markup, an HTML <link rel="ard"> tag, and DNS service-binding records; a conforming consumer is only required to fetch /.well-known/ard.json and honour rel="ard", so Agentmap: is a convenience a crawler may use, not something it must support. It is not part of RFC 9309 (the Robots Exclusion Protocol), so a robots.txt parser that does not know ARD is free to ignore the line, and no major AI crawler is documented as consuming it. Used by: ard.