apify.com agentic web readiness
A Score 55 (coverage 30 + breadth 15 + conformance 10). 7 standards observed across 3 of 9 steps; 7 manifests present, 1 error, 1 warning. Checked 2026-10-19 00:41:47 UTC. This grades the agent-facing files published at apify.com, not the organisation's products.
Coverage by step
Manifests
| Manifest | Result | Findings |
|---|---|---|
Agentic Resource Discovery/.well-known/ard.json | absent HTTP 404 | |
AI Catalog well-known file/.well-known/ai-catalog.json | valid HTTP 200 | |
MCP Server Cards (SEP-2127)/mcp/server-card | absent HTTP 404 | |
Agent2Agent Protocol/.well-known/agent-card.json | absent HTTP 404 | |
llms.txt/llms.txt | valid HTTP 200 | |
AGENTS.md/AGENTS.md | valid HTTP 200 | |
api-catalog: A Well-Known URI and Link Relation to Help Discovery of APIs/.well-known/api-catalog | valid HTTP 200 | |
AI Crawler User-Agent Tokens in robots.txt/robots.txt | valid HTTP 200 |
|
security.txt (RFC 9116)/.well-known/security.txt | valid HTTP 200 | |
auth.md/auth.md | errors HTTP 200 |
|
What an agent can call
- API description
https://apify.com/.well-known/api-catalog(application/linkset+json) - API description
https://apify.com/openapi.json(application/vnd.oai.openapi+json;version=3.1) - API description
https://apify.com/openapi.json(application/json) - API description
https://docs.apify.com/api/openapi.json(application/json) - API description
https://api.apify.com/v2/openapi.json(application/json) - API description
https://docs.apify.com/api/v2(text/html) - API description
https://mcp.apify.com/.well-known/mcp/server-card.json(application/json) - API description
https://docs.apify.com/integrations/mcp(text/html) - llms.txt: Apify, 73 links
- robots.txt AI policy: unlisted crawlers allowed; Agentmap https://apify.com/.well-known/ai-catalog.json
- OAuth protected resource
https://mcp.apify.com, authorization servers: https://console-backend.apify.com
Standards observed
- llms.txt https://apify.com/llms.txt
- AGENTS.md https://apify.com/AGENTS.md
- Content Signals Policy https://apify.com/robots.txt
- AI Catalog well-known file https://apify.com/.well-known/ai-catalog.json
- api-catalog: A Well-Known URI and Link Relation to Help Discovery of APIs https://apify.com/.well-known/api-catalog
- OAuth Protected Resource and Authorization Server Metadata (as used for agent authorization) https://apify.com/.well-known/oauth-protected-resource
- AI Crawler User-Agent Tokens in robots.txt
Cheapest next steps
- Agentic Resource Discovery: a catalog at /.well-known/ard.json lets agents discover your APIs, MCP servers and data in one fetch
- MCP Server Cards (SEP-2127): if you run an MCP server, a SEP-2127 card at <mcp-url>/server-card lets clients configure themselves
How the grade is made
+10 per lifecycle step with a standard observed, counting manifests that validate or that the probe rule for the standard recognises (a valid MCP server card counts for MCP; max 90); +3 per observed standard beyond the first two (max 15); conformance +15 (+10 with one manifest) minus 5 per agent-facing manifest with errors, never below 0 (security.txt is reported, not scored). A+ >= 60, A >= 45, B >= 30, C >= 20, D >= 10. Errors are specification violations; warnings are best-practice gaps. Only public paths are fetched, without credentials, so standards that need a login (skipped in the probe) are not counted either way. The same report is the validate_manifest tool on the MCP server.
JSON · Markdown · probe rules