gurubase.io agentic web readiness

A+ Manifest validity: 75% (6/8 valid, 3 errors, 6 warnings) · Surface score 60 (coverage 40 + breadth 15 + conformance 5). 9 standards observed across 4 of 9 steps; 8 manifests present, 3 errors, 6 warnings. Checked 2026-10-25 23:11:47 UTC. This grades the agent-facing files published at gurubase.io, not the organisation's products.

Badge for a README: ![agentic web grade](https://agenticweb.wiki/badge/gurubase.io.svg) · JSON · Markdown · Re-check now

Coverage by step

Manifests

{
  "$schema": "https://static.modelcontextprotocol.io/schemas/v1/server-card.schema.json",
  "name": "io.gurubase/gurubase",
  "title": "Gurubase",
  "version": "1.0.0",
  "description": "Gurubase and what it offers to agents",
  "websiteUrl": "https://gurubase.io/",
  "icons": [
    {
      "src": "https://gurubase.io/icon.png",
      "mimeType": "image/png",
      "sizes": [
        "180x180"
      ]
    }
  ],
  "remotes": [
    {
      "type": "streamable-http",
      "url": "https://gurubase.io/mcp",
      "supportedProtocolVersions": [
        "2025-11-25",
        "2025-06-18",
        "2025-03-26"
      ]
    }
  ]
}

# Authenticating to Gurubase as an agent

This file is the agent-auth skill for gurubase.io. It is linked from the authorization server's metadata (`agent_auth.skill`).

## Discovery
1. Call the API. A `401` carries `WWW-Authenticate: Bearer resource_metadata="https://gurubase.io/.well-known/oauth-protected-resource"`.
2. Read `/.well-known/oauth-protected-resource` (RFC 9728) for `resource` and `authorization_servers`.
3. Read the authorization server's `/.well-known/oauth-authorization-server` (RFC 8414); the `agent_auth` block lists the endpoints below.

## Methods we accept
- `identity_assertion`: you hold a session for a user and can mint an ID-JAG with `aud` = our `resource`. Preferred.
- `service_auth`: you only know the user's email. A claim ceremony (6-digit code) is required.
- `anonymous`: no user. Immediate limited scopes; the user can claim later.

## Register
POST `agent_auth.identity_endpoint` with `{"type": "<method>", ...}`; exchange the returned `identity_assertion` at the token endpoint for an access token.

## Scopes
- `api.read`: read
- `api.write`: write (claimed registrations only)

## Rules
- Show the user our name and the scopes before asserting their identity.
- Keep `claim_token` in memory only.
- Revocation events arrive as Security Event Tokens at your registered events endpoint.

What an agent can call

• MCP endpoint https://api.gurubase.io/mcp/{guru_slug}/ (streamable-http) — from /.well-known/mcp/server-card.json
• API description https://gurubase.io/.well-known/api-catalog (application/linkset+json)
• API description https://gurubase.io/.well-known/api-catalog (application/linkset+json)
• API description https://docs.gurubase.ai/llms.txt (text/markdown)
• API description https://docs.gurubase.ai/api-reference/introduction (text/html)
• API description https://gurubase.io/.well-known/mcp/server-card.json (application/json)
• API description https://docs.gurubase.ai/guides/mcp-server (text/html)
• llms.txt: Gurubase, 43 links
• robots.txt AI policy: allows GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-Web, Google-Extended, PerplexityBot, CCBot, meta-externalagent, cohere-ai, YouBot; unlisted crawlers allowed; Agentmap https://gurubase.io/.well-known/ard.json
• Endpoint check (mcp https://api.gurubase.io/mcp/{guru_slug}/): dead (endpoint URL contains unexpanded template variable)
• ARD bridge (/.well-known/ard.json): 1/3 valid, 1 legacy, 0 dead/broken

Standards observed

• llms.txt https://gurubase.io/llms.txt
• Content Signals Policy https://gurubase.io/robots.txt
• Agentic Resource Discovery https://gurubase.io/.well-known/ard.json
• AI Catalog well-known file https://gurubase.io/.well-known/ai-catalog.json
• api-catalog: A Well-Known URI and Link Relation to Help Discovery of APIs https://gurubase.io/.well-known/api-catalog
• AI Crawler User-Agent Tokens in robots.txt https://gurubase.io/robots.txt
• Agent Skills https://gurubase.io/.well-known/agent-skills/index.json
• Markdown for Agents https://gurubase.io/
• MCP Server Cards (SEP-2127)

Cheapest next steps

1. AGENTS.md: instructions for coding agents working on or with the site
   Generate starter /AGENTS.md for gurubase.io

   # Gurubase for agents
   
   Gurubase and what it offers to agents
   
   ## Read the data, not the HTML
   - Index: https://gurubase.io/llms.txt
   - API description: https://gurubase.io/openapi.json
   - Discovery catalog: https://gurubase.io/.well-known/ard.json
   
   ## Calling
   - MCP server (Streamable HTTP): https://gurubase.io/mcp
   - Rate limits and authentication: describe them here
   
   ## Conventions
   - How to cite or attribute content
   - What not to do (no scraping of /account/, no automated sign-ups, etc.)
   
   Contact: security@gurubase.io
   

2. security.txt (RFC 9116): RFC 9116 contact and expiry, read by agents and people
   Generate starter /.well-known/security.txt for gurubase.io

   Contact: mailto:security@gurubase.io
   Expires: 2027-09-20T23:11:47Z
   Canonical: https://gurubase.io/.well-known/security.txt
   Preferred-Languages: en
   Policy: https://gurubase.io/security-policy
   

Agent pre-flight & practical readiness

Preferred mode: agent_skills (fallback llms_txt). GET the Agent Skills index and load the SKILL.md files it lists. Those files are the procedure; the HTML is not.

Fetch: GET https://gurubase.io/.well-known/agent-skills/index.json GET the Agent Skills index, then fetch the SKILL.md URLs it lists.

Practical readability: exa_parsable yes, markdown negotiation yes, render markdown_native, HTML quality high, first content at byte 0.

AI crawler posture: open_to_all · Assistant access: OpenAI allowed, Anthropic allowed, Google allowed, Perplexity allowed, Exa allowed.

Readiness subscores: reach 20/20, readability 30/30, capabilities 14/35, conformance 5/15, total 69/100, grade A.

How the grade is made

+10 per lifecycle step with a standard observed, counting manifests that validate or that the probe rule for the standard recognises (a valid MCP server card counts for MCP; max 90); +3 per observed standard beyond the first two (max 15); conformance +15 (+10 with one manifest) minus 5 per agent-facing manifest with errors, never below 0 (security.txt is reported, not scored). Lifecycle grade: A+ >= 60, A >= 45, B >= 30, C >= 20, D >= 10. Strict 100-point composite (subscores.total_100 / subscores.grade_100): reach_and_policy (20) + readability (30) + capabilities (35) + conformance (15), where A+ >= 80, A >= 65, B >= 45, C >= 28, D >= 15. Errors are specification violations; warnings are best-practice gaps. Only public paths are fetched, without credentials, so standards that need a login (skipped in the probe) are not counted either way. The same report is the validate_manifest tool on the MCP server.

JSON · Markdown · probe rules