cerebrium.ai agentic web readiness
A+ Manifest validity: 80% (4/5 valid, 2 errors, 9 warnings) · Surface score 72 (coverage 50 + breadth 12 + conformance 10). 6 standards observed across 5 of 9 steps; 5 manifests present, 2 errors, 9 warnings. Checked 2026-10-25 19:18:23 UTC. This grades the agent-facing files published at cerebrium.ai, not the organisation's products.
Coverage by step
Manifests
| Manifest | Result | Findings |
|---|---|---|
Agentic Resource Discovery/.well-known/ard.json | absent HTTP 404 | |
AI Catalog well-known file/.well-known/ai-catalog.json | absent HTTP 404 | |
MCP Server Cards (SEP-2127)/.well-known/mcp/server-card.json | errors |
View valid |
Agent2Agent Protocol/.well-known/agent-card.json | valid |
|
llms.txt/llms.txt | valid | |
AGENTS.md/AGENTS.md | absent HTTP 404 | |
Agent Skills/.well-known/agent-skills/index.json | valid | |
api-catalog: A Well-Known URI and Link Relation to Help Discovery of APIs/.well-known/api-catalog | absent HTTP 404 | |
AI Crawler User-Agent Tokens in robots.txt/robots.txt | valid |
|
security.txt (RFC 9116)/.well-known/security.txt | absent HTTP 404 | |
auth.md/auth.md | absent HTTP 404 | |
Open Knowledge Format/okf/index.md | absent HTTP 404 |
What an agent can call
- MCP endpoint
https://cerebrium.ai/docs/mcp(http) — from/.well-known/mcp.json - MCP endpoint
https://cerebrium.ai/docs/mcp(http), tools: search_cerebrium, query_docs_filesystem_cerebrium — from/.well-known/mcp/server-card.json - A2A agent Cerebrium at
https://cerebrium.ai/docs/, skills: cerebrium - llms.txt: Cerebrium, 97 links
- robots.txt AI policy: allows GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, Google-Extended, PerplexityBot, Perplexity-User, Applebot-Extended, meta-externalagent, Bytespider, Amazonbot, cohere-ai; unlisted crawlers allowed
Standards observed
- Agent2Agent Protocol https://cerebrium.ai/.well-known/agent-card.json
- llms.txt https://cerebrium.ai/llms.txt
- AI Crawler User-Agent Tokens in robots.txt https://cerebrium.ai/robots.txt
- Agent Skills https://cerebrium.ai/.well-known/agent-skills/index.json
- MCP Server Cards (SEP-2127)
- Model Context Protocol
Cheapest next steps
- Agentic Resource Discovery: a catalog at /.well-known/ard.json lets agents discover your APIs, MCP servers and data in one fetch
- AGENTS.md: instructions for coding agents working on or with the site
Generate starter
/AGENTS.mdfor cerebrium.ai# Cerebrium for agents Cerebrium and what it offers to agents ## Read the data, not the HTML - Index: https://cerebrium.ai/llms.txt - API description: https://cerebrium.ai/openapi.json - Discovery catalog: https://cerebrium.ai/.well-known/ard.json ## Calling - MCP server (Streamable HTTP): https://cerebrium.ai/mcp - Rate limits and authentication: describe them here ## Conventions - How to cite or attribute content - What not to do (no scraping of /account/, no automated sign-ups, etc.) Contact: security@cerebrium.ai
- api-catalog: A Well-Known URI and Link Relation to Help Discovery of APIs: an RFC 9727 linkset pointing at your OpenAPI description
Agent pre-flight & practical readiness
Preferred mode: mcp (fallback a2a). Call the MCP endpoint at https://cerebrium.ai/docs/mcp first. Do not scrape the HTML when a tool can answer.
Fetch: POST https://cerebrium.ai/docs/mcp POST a JSON-RPC tools/list, or server/discover on the 2026-07-28 revision, before reading HTML.
Practical readability: exa_parsable yes, markdown negotiation no, render ssr_rich, HTML quality high, first content at byte 232213 (~227 KB of head/script markup before main text), HTML-to-llms.txt token ratio 19.234×, JSON-LD Organization, ContactPoint, WebSite, ImageObject, SoftwareApplication, Offer.
AI crawler posture: open_to_all · Assistant access: OpenAI allowed, Anthropic allowed, Google allowed, Perplexity allowed, Exa allowed.
Readiness subscores: reach 20/20, readability 22/30, capabilities 27/35, conformance 10/15, total 79/100, grade A+.
How the grade is made
+10 per lifecycle step with a standard observed, counting manifests that validate or that the probe rule for the standard recognises (a valid MCP server card counts for MCP; max 90); +3 per observed standard beyond the first two (max 15); conformance +15 (+10 with one manifest) minus 5 per agent-facing manifest with errors, never below 0 (security.txt is reported, not scored). Lifecycle grade: A+ >= 60, A >= 45, B >= 30, C >= 20, D >= 10. Strict 100-point composite (subscores.total_100 / subscores.grade_100): reach_and_policy (20) + readability (30) + capabilities (35) + conformance (15), where A+ >= 80, A >= 65, B >= 45, C >= 28, D >= 15. Errors are specification violations; warnings are best-practice gaps. Only public paths are fetched, without credentials, so standards that need a login (skipped in the probe) are not counted either way. The same report is the validate_manifest tool on the MCP server.
JSON · Markdown · probe rules