--- type: Agentic Web Standard title: "AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences)" description: "What controlled set of values expresses a publisher's AI-use preferences, independent of how they are attached to content?" resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-08.txt" tags: ["permit", "document-format", "ietf", "control-ai-crawling"] status: draft generated: { by: agenticweb-builder/1.0, at: 2026-10-30T00:00:00Z } verified: { by: process:agenticweb-engine, at: 2026-10-28T00:00:00Z } stale_after: 2026-11-27T00:00:00Z sources: - id: ref-1 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-08.txt" title: "P. Keller (Open Future) and M. Thomson (Mozilla, editor), A Vocabulary For Expressing AI Usage Preferences, draft-ietf-aipref-vocab-08, Internet-Draft, 14 September 2026, checked 2026-10-28: \"This document defines a vocabulary for expressing preferences regarding how digital assets are used by automated processing systems.\" \"This vocabulary allows for the declaration of restrictions or permissions for use of digital assets by such systems.\" \"Its contents DO NOT REFLECT CONSENSUS of the Working Group either in whole or part. Presense or absense of any particular text does not indicate consensus, and this document is published solely as a basis of further discussion.\" \"This section does not yet have consensus\" \"Using an asset to modify the learned parameters of a generative AI model.\" \"Using an asset as input to a generative AI model, where the asset is not directly provided by the user.\" \"Using an asset in an application where the primary purpose of the application is to select assets and direct users to the location of those assets.\" \"This category does not include the use of assets to generate summaries.\" \"This category of use overrides any usage that falls into other categories, including AI Training (Section 4.1) and AI Use (Section 4.2).\" \"Extensions to this vocabulary are defined in a standards-track RFC that updates this document.\" \"This process results in one of three potential answers: allow, disallow, and unknown.\" \"This document takes no position on what default might be assigned.\" \"This process ensures that the most restrictive preference applies.\" \"For example, the following states a preference to allow model training (Section 4.1), disallow search (Section 4.3), with the preference for other categories being unknown: train-ai=y, search=n\" \"when processing a parsed Dictionary to obtain preferences, any unknown labels MUST be ignored.\" \"An entity that receives usage preferences has a choice whether to follow those preferences.\" \"Preferences are not a security mechanism.\"" last_modified: 2026-09-14T00:00:00Z - id: ref-2 resource: "https://datatracker.ietf.org/doc/draft-ietf-aipref-vocab/" title: "IETF Datatracker, draft-ietf-aipref-vocab document page, checked 2026-10-28: \"Document Type Active Internet-Draft (aipref WG) Authors Paul Keller, Martin Thomson\" \"Replaces draft-keller-aipref-vocab\" \"Intended RFC status Proposed Standard\" \"WG state WG Document\" \"IESG state I-D Exists\" \"Associated WG milestone Aug 2026 A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication\"" last_modified: 2026-10-28T00:00:00Z - id: ref-3 resource: "https://datatracker.ietf.org/doc/draft-ietf-aipref-vocab/history/" title: "IETF Datatracker, draft-ietf-aipref-vocab history, checked 2026-10-28: \"2025-04-30 00 Mark Nottingham WG -00 approved\" \"Mark Nottingham IETF WG state changed to In WG Last Call from WG Document\" \"Mark Nottingham IETF WG state changed to WG Document from In WG Last Call\"" last_modified: 2026-10-28T00:00:00Z - id: ref-4 resource: "https://datatracker.ietf.org/api/v1/doc/document/draft-ietf-aipref-vocab/?format=json" title: "IETF Datatracker API, draft-ietf-aipref-vocab document record (rev \"08\", time \"2026-09-14T06:18:02Z\", expires \"2027-03-18T06:18:02Z\"), checked 2026-10-28: \"2026-09-14T06:18:02Z\"" last_modified: 2026-09-14T00:00:00Z - id: ref-5 resource: "https://datatracker.ietf.org/api/v1/doc/newrevisiondocevent/?doc__name=draft-ietf-aipref-vocab&format=json&limit=50" title: "IETF Datatracker API, new-revision events for draft-ietf-aipref-vocab (posting times in UTC), checked 2026-10-28: \"New version available: draft-ietf-aipref-vocab-08.txt\"" last_modified: 2026-09-14T00:00:00Z - id: ref-6 resource: "https://datatracker.ietf.org/api/v1/doc/document/?group__acronym=aipref&type=rfc&format=json" title: "IETF Datatracker API, documents of type RFC in group aipref (total_count 0), checked 2026-10-28: \"total_count\": 0" last_modified: 2026-10-28T00:00:00Z - id: ref-7 resource: "https://datatracker.ietf.org/wg/aipref/about/" title: "IETF Datatracker, AI Preferences (aipref) working group, About page with charter and milestones, checked 2026-10-28: \"Area Web and Internet Transport (wit) State Active Charter charter-ietf-aipref-01 Approved\" \"Chairs Mark Nottingham, Suresh Krishnan Area Director Mike Bishop\" \"The AI Preferences Working Group will standardize building blocks that allow for the expression of preferences about how content is collected and processed for Artificial Intelligence (AI) model development, deployment, and use.\" \"A standard track document covering vocabulary for expressing AI-related preferences, independent of how those preferences are associated with content.\" \"Technical enforcement of preferences\" \"2026-08-31 Aug 2026 A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication draft-ietf-aipref-vocab\"" last_modified: 2026-10-28T00:00:00Z - id: ref-8 resource: "https://datatracker.ietf.org/wg/aipref/history/" title: "IETF Datatracker, aipref working group history, checked 2026-10-28: \"2025-01-07 Cindy Morgan Charter approved, group active\" \"2025-09-23 Mike Bishop Changed milestone \"A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication\", set due date to August 2026 from August\"" last_modified: 2026-10-28T00:00:00Z - id: ref-9 resource: "https://datatracker.ietf.org/doc/draft-keller-aipref-vocab/" title: "IETF Datatracker, draft-keller-aipref-vocab, checked 2026-10-28: \"Replaced Internet-Draft (candidate for aipref WG) Expired & archived Author Paul Keller Last updated 2025-04-10 (Latest revision 2025-03-30) Replaced by draft-ietf-aipref-vocab\"" last_modified: 2025-04-10T00:00:00Z - id: ref-10 resource: "https://mailarchive.ietf.org/arch/msg/ai-control/LuWDC12gjlQ6Yj5eKN7ZkgbxopA/" title: "Mark Nottingham, [ai-control] Adoption of draft-keller-aipref-vocab-01, ai-control mailing list, 2025-04-26, checked 2026-10-28: \"your chairs believe there is rough consensus to adopt draft-keller-aipref-vocab-01 as the starting point of our vocabulary work.\" \"Accordingly, we appoint Paul Keller and Martin Thomson as editors.\"" last_modified: 2025-04-26T00:00:00Z - id: ref-11 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-00.txt" title: "P. Keller and M. Thomson, Proposal for an Opt-Out Vocabulary, draft-ietf-aipref-vocab-00, 1 May 2025, checked 2026-10-28: \"This document proposes a standardized vocabulary of use cases that can be targeted when expressing machine-readable opt-outs related to Text and Data Mining (TDM) and AI training.\"" last_modified: 2025-05-01T00:00:00Z - id: ref-12 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-01.txt" title: "draft-ietf-aipref-vocab-01 (category table: tdm, ai, genai, search, inference), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2025-06-19T00:00:00Z - id: ref-13 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-02.txt" title: "draft-ietf-aipref-vocab-02 (category table: all, train-ai, train-genai, ai-use, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2025-07-21T00:00:00Z - id: ref-14 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-03.txt" title: "draft-ietf-aipref-vocab-03 (category table: bots, train-ai, train-genai, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2025-09-05T00:00:00Z - id: ref-15 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-04.txt" title: "draft-ietf-aipref-vocab-04 (category table: bots, train-ai, ai-output, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2025-10-28T00:00:00Z - id: ref-16 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-05.txt" title: "draft-ietf-aipref-vocab-05 (category table: train-ai, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2025-12-01T00:00:00Z - id: ref-17 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-06.txt" title: "draft-ietf-aipref-vocab-06 (category table: train-ai, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2026-04-28T00:00:00Z - id: ref-18 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-07.txt" title: "draft-ietf-aipref-vocab-07 (category table: train-ai, search), checked 2026-10-28: \"Table 1 tabulates this mapping.\"" last_modified: 2026-08-19T00:00:00Z - id: ref-19 resource: "https://www.ietf.org/archive/id/draft-ietf-aipref-attach-05.txt" title: "G. Illyes (Google) and M. Thomson (Mozilla), Associating AI Usage Preferences with Content in HTTP, draft-ietf-aipref-attach-05, 19 August 2026, checked 2026-10-28: \"Methods are defined for associating usage preferences with content that is obtained using the HTTP protocol. This document defines attachment methods using the Robots Exclusion Protocol and HTTP header fields.\" \"This document updates RFC 9309 to allow for the inclusion of usage preferences.\" \"The Content-Usage field is a structured field dictionary, as defined in Section 3.2 of [FIELDS]. This field follows the vocabulary and processing rules in [VOCAB].\"" last_modified: 2026-08-19T00:00:00Z - id: ref-20 resource: "https://datatracker.ietf.org/doc/draft-ietf-aipref-attach/" title: "IETF Datatracker, draft-ietf-aipref-attach document page, checked 2026-10-28: \"Associating AI Usage Preferences with Content in HTTP\"" last_modified: 2026-10-28T00:00:00Z - id: ref-21 resource: "https://datatracker.ietf.org/doc/draft-ietf-aipref-attach/history/" title: "IETF Datatracker, draft-ietf-aipref-attach history, checked 2026-10-28: \"2026-05-01 04 (System) Document has expired\" \"2026-08-18 05 Martin Thomson New version available: draft-ietf-aipref-attach-05.txt\"" last_modified: 2026-10-28T00:00:00Z - id: ref-22 resource: "https://github.com/ietf-wg-aipref/drafts" title: "GitHub, ietf-wg-aipref/drafts repository, checked 2026-10-28: \"AIPREF working drafts\"" last_modified: 2026-10-28T00:00:00Z - id: ref-23 resource: "https://ietf-wg-aipref.github.io/drafts/draft-ietf-aipref-vocab.html" title: "Editor's copy of the vocabulary draft on GitHub Pages, checked 2026-10-28: \"A Vocabulary For Expressing AI Usage Preferences\"" last_modified: 2026-10-28T00:00:00Z - id: ref-24 resource: "https://blog.cloudflare.com/content-signals-policy/" title: "Will Allen, Cloudflare Blog, Giving users choice with Cloudflare's new Content Signals Policy, 2025-09-24, checked 2026-10-28: \"This policy defines three content signals - search, ai-input, and ai-train - and their relevance to crawlers.\"" last_modified: 2025-09-24T00:00:00Z - id: ref-25 resource: "https://mailarchive.ietf.org/arch/msg/ai-control/EANb9b9bljOanLBFm5FRerYlxyI/" title: "Michael Tremante, [ai-control] Cloudflare's Content Signal Policy, ai-control mailing list, 2025-09-24, checked 2026-10-28: \"We see this as an interim measure to address immediate needs, while work is done towards standardization.\" \"We will continue to engage in this working group and hope we can achieve a consensus position and will revisit our policy once that has happened.\"" last_modified: 2025-09-24T00:00:00Z - id: ref-26 resource: "https://datatracker.ietf.org/doc/html/draft-romm-aipref-contentsignals-00" title: "M. Tremante and L. Romm, draft-romm-aipref-contentsignals-00, individual Internet-Draft, 2025-10-01, checked 2026-10-28: \"The proposal is for these categories to nest within the larger category of Automated Processing\"" last_modified: 2025-10-01T00:00:00Z - id: ref-27 resource: "https://datatracker.ietf.org/doc/draft-romm-aipref-contentsignals/" title: "IETF Datatracker, draft-romm-aipref-contentsignals, checked 2026-10-28: \"Expired Internet-Draft (individual) Expired & archived Authors Michael Tremante, Leah Romm\"" last_modified: 2026-10-28T00:00:00Z - id: ref-28 resource: "https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/" title: "Bryan Becker, Cloudflare Blog, Have it both ways: stay discoverable in search while disallowing AI training, 2026-09-15, checked 2026-10-28: \"As standards such as ai-prefs mature, we will revisit this approach.\" \"Open standards such as ai-prefs will be an important part of making that possible.\"" last_modified: 2026-09-15T00:00:00Z - id: ref-29 resource: "https://www.cloudflare.com/press/press-releases/2026/cloudflare-helps-end-the-search-or-ai-training-tradeoff/" title: "Cloudflare press release, Cloudflare Helps End the Search-or-AI-Training Tradeoff, 2026-09-15, checked 2026-10-28: \"Cloudflare is also an active participant in open standards work at the Internet Engineering Task Force (IETF), including \"ai-prefs,\" a specification under development that would allow any website to express its AI access preferences in a standardized, portable way.\" \"Today's controls are designed to work alongside these emerging standards.\"" last_modified: 2026-09-15T00:00:00Z - id: ref-30 resource: "https://contentsignals.org/" title: "contentsignals.org, site description (meta description, undated), checked 2026-10-28: \"An up-to-date guide to the IETF's proposed new AI Preferences (aipref): a new way for website publishers to control how automated systems use their content.\"" last_modified: 2026-10-28T00:00:00Z - id: ref-31 resource: "https://www.spinxo.com/robots.txt" title: "SpinXO, robots.txt, checked 2026-10-28: \"AI usage preference (draft-ietf-aipref-attach).\"" last_modified: 2026-10-28T00:00:00Z - id: ref-32 resource: "https://www.spinxo.com/" title: "SpinXO, home page HTTP response header, checked 2026-10-28: \"content-usage: train-ai=y, search=y\"" last_modified: 2026-10-28T00:00:00Z - id: ref-33 resource: "https://launchpad.net/robots.txt" title: "Launchpad, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-34 resource: "https://bugs.launchpad.net/robots.txt" title: "Launchpad Bugs, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-35 resource: "https://code.launchpad.net/robots.txt" title: "Launchpad Code, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-36 resource: "https://answers.launchpad.net/robots.txt" title: "Launchpad Answers, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-37 resource: "https://changelogs.ubuntu.com/robots.txt" title: "Ubuntu Changelogs, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-38 resource: "https://theysaidso.com/robots.txt" title: "They Said So, robots.txt, checked 2026-10-28: \"Content-Usage: ai=n\"" last_modified: 2026-10-28T00:00:00Z - id: ref-39 resource: "https://www.ai-siteready.com/blog/content-usage-aipref-robots-txt-http" title: "IMozz, ai SiteReady, Content-Usage (aipref): robots.txt and HTTP header snippets, updated 2026-10-11, checked 2026-10-28: \"I could not find a primary source from a major crawler operator saying it reads Content-Usage, so treat support as unknown and uneven.\"" last_modified: 2026-10-11T00:00:00Z - id: ref-40 resource: "https://www.ietf.org/blog/ai-pref-update/" title: "Mark Nottingham and Suresh Krishnan, IETF Blog, Enabling Publishers to Express Preferences for AI Crawlers: An Update on the AIPREF Working Group, 2025-10-30, checked 2026-10-28: \"Accordingly, we made a Working Group Last Call on the documents in September.\" \"The response was not one we anticipated: several participants raised fundamental issues about the nature of the Internet-Drafts (I-Ds), forcing the group to reconsider its approach.\"" last_modified: 2025-10-30T00:00:00Z - id: ref-41 resource: "https://aicrawlercheck.com/blog/ietf-aipref-content-usage-robots-txt" title: "AI Crawler Check, Content-Usage in robots.txt: The IETF AIPREF Standard Explained, 2026-10-18, checked 2026-10-28: \"No major AI company has said publicly that its crawler reads Content-Usage yet, while every major one documents its tokens.\"" last_modified: 2026-10-18T00:00:00Z - id: ref-42 resource: "https://scholarlykitchen.sspnet.org/2026/10/22/guest-post-all-this-ai-signal-and-noise-what-deserves-action-now/" title: "Will Schweitzer, The Scholarly Kitchen, Guest Post — All this AI Signal and Noise: What Deserves Action Now, 2026-10-22, checked 2026-10-28: \"On September 13, the AI preferences working group published a vocabulary with three verbs: training, use, and search.\"" last_modified: 2026-10-22T00:00:00Z --- # AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences) AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences) is an agentic-web standard (document format — /robots.txt) at step 3, Permit, governed by IETF AI Preferences working group: Area Web and Internet Transport State Active Charter charter-ietf-aipref-01 Approved Chairs Mark Nottingham, Suresh Krishnan Area Director Mike Bishop; its status is "Active Internet-Draft, not an RFC: Document Type Active Internet-Draft Authors Paul Keller, Martin Thomson WG state WG Document IESG state I-D Exists". It answers: "What controlled set of values expresses a publisher's AI-use preferences, independent of how they are attached to content?" Implementation status is none found, last verified 2026-10-28. # Overview The AIPREF vocabulary is the IETF working-group draft that names kinds of automated use of web content, so that a publisher can say whether each is allowed: "This document defines a vocabulary for expressing preferences regarding how digital assets are used by automated processing systems." [^ref-1]. The current draft has three categories, AI Training, AI Use and Search, where Search covers applications that direct users to the original location and overrides the other two categories [^ref-1]. It defines meaning and a short text form such as "train-ai=y, search=n" but no place to put it; the companion attachment draft carries the same string in robots.txt and in an HTTP header [^ref-1][^ref-19]. It is a statement of preference, not a control: "An entity that receives usage preferences has a choice whether to follow those preferences." [^ref-1]. # Examples ```http GET {origin}/robots.txt # parse: Parse any Content-Usage directive value against the AIPREF controlled vocabulary tokens defined in this draft # on absent: No AIPREF-vocabulary token found in the attachment surface; cannot distinguish 'no preference stated' from 'publisher uses a different vocabulary (e.g. Cloudflare Content Signals)' ``` # Knowledge Graph * **Lifecycle Step**: [3 Permit](/category/permit/index.md) * **Depended on by**: [AIPREF Content-Usage Attachment](/okf/protocols/aipref-content-usage-attachment.md) * **Pairs with**: [AIPREF Content-Usage Attachment](/okf/protocols/aipref-content-usage-attachment.md), [Content Signals Policy](/okf/protocols/cloudflare-content-signals-policy.md), [AI crawler tokens in robots.txt](/okf/protocols/ai-crawler-tokens-robots.md), [TDMRep (TDM Reservation Protocol)](/okf/protocols/tdmrep.md), [Really Simple Licensing](/okf/protocols/rsl.md), [ai.txt](/okf/protocols/ai-txt.md) * **Related terms**: [Content usage preference](/okf/terms/content-usage-preference.md) * **Compared in**: [robots.txt (Allow/Disallow) vs Content-Signal, AIPREF & TDMRep (classic vs agentic)](/compare/robots-txt-vs-content-signal/index.md), [TDMRep (TDM Reservation Protocol) vs AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences)](/compare/tdmrep-vs-aipref-vocabulary/index.md), [Really Simple Licensing vs AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences)](/compare/rsl-vs-aipref-vocabulary/index.md), [Content Signals Policy vs AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences)](/compare/cloudflare-content-signals-policy-vs-aipref-vocabulary/index.md), [AIPREF Content-Usage Attachment vs AIPREF Vocabulary (A Vocabulary For Expressing AI Usage Preferences)](/compare/aipref-content-usage-attachment-vs-aipref-vocabulary/index.md) [^ref-1]: P. Keller (Open Future) and M. Thomson (Mozilla, editor), A Vocabulary For Expressing AI Usage Preferences, draft-ietf-aipref-vocab-08, Internet-Draft, 14 September 2026, checked 2026-10-28: "This document defines a vocabulary for expressing preferences regarding how digital assets are used by automated processing systems." "This vocabulary allows for the declaration of restrictions or permissions for use of digital assets by such systems." "Its contents DO NOT REFLECT CONSENSUS of the Working Group either in whole or part. Presense or absense of any particular text does not indicate consensus, and this document is published solely as a basis of further discussion." "This section does not yet have consensus" "Using an asset to modify the learned parameters of a generative AI model." "Using an asset as input to a generative AI model, where the asset is not directly provided by the user." "Using an asset in an application where the primary purpose of the application is to select assets and direct users to the location of those assets." "This category does not include the use of assets to generate summaries." "This category of use overrides any usage that falls into other categories, including AI Training (Section 4.1) and AI Use (Section 4.2)." "Extensions to this vocabulary are defined in a standards-track RFC that updates this document." "This process results in one of three potential answers: allow, disallow, and unknown." "This document takes no position on what default might be assigned." "This process ensures that the most restrictive preference applies." "For example, the following states a preference to allow model training (Section 4.1), disallow search (Section 4.3), with the preference for other categories being unknown: train-ai=y, search=n" "when processing a parsed Dictionary to obtain preferences, any unknown labels MUST be ignored." "An entity that receives usage preferences has a choice whether to follow those preferences." "Preferences are not a security mechanism." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-08.txt) [^ref-2]: IETF Datatracker, draft-ietf-aipref-vocab document page, checked 2026-10-28: "Document Type Active Internet-Draft (aipref WG) Authors Paul Keller, Martin Thomson" "Replaces draft-keller-aipref-vocab" "Intended RFC status Proposed Standard" "WG state WG Document" "IESG state I-D Exists" "Associated WG milestone Aug 2026 A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication" (https://datatracker.ietf.org/doc/draft-ietf-aipref-vocab/) [^ref-3]: IETF Datatracker, draft-ietf-aipref-vocab history, checked 2026-10-28: "2025-04-30 00 Mark Nottingham WG -00 approved" "Mark Nottingham IETF WG state changed to In WG Last Call from WG Document" "Mark Nottingham IETF WG state changed to WG Document from In WG Last Call" (https://datatracker.ietf.org/doc/draft-ietf-aipref-vocab/history/) [^ref-4]: IETF Datatracker API, draft-ietf-aipref-vocab document record (rev "08", time "2026-09-14T06:18:02Z", expires "2027-03-18T06:18:02Z"), checked 2026-10-28: "2026-09-14T06:18:02Z" (https://datatracker.ietf.org/api/v1/doc/document/draft-ietf-aipref-vocab/?format=json) [^ref-5]: IETF Datatracker API, new-revision events for draft-ietf-aipref-vocab (posting times in UTC), checked 2026-10-28: "New version available: draft-ietf-aipref-vocab-08.txt" (https://datatracker.ietf.org/api/v1/doc/newrevisiondocevent/?doc__name=draft-ietf-aipref-vocab&format=json&limit=50) [^ref-6]: IETF Datatracker API, documents of type RFC in group aipref (total_count 0), checked 2026-10-28: "total_count": 0 (https://datatracker.ietf.org/api/v1/doc/document/?group__acronym=aipref&type=rfc&format=json) [^ref-7]: IETF Datatracker, AI Preferences (aipref) working group, About page with charter and milestones, checked 2026-10-28: "Area Web and Internet Transport (wit) State Active Charter charter-ietf-aipref-01 Approved" "Chairs Mark Nottingham, Suresh Krishnan Area Director Mike Bishop" "The AI Preferences Working Group will standardize building blocks that allow for the expression of preferences about how content is collected and processed for Artificial Intelligence (AI) model development, deployment, and use." "A standard track document covering vocabulary for expressing AI-related preferences, independent of how those preferences are associated with content." "Technical enforcement of preferences" "2026-08-31 Aug 2026 A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication draft-ietf-aipref-vocab" (https://datatracker.ietf.org/wg/aipref/about/) [^ref-8]: IETF Datatracker, aipref working group history, checked 2026-10-28: "2025-01-07 Cindy Morgan Charter approved, group active" "2025-09-23 Mike Bishop Changed milestone "A standard track specification describing vocabulary for expressing AI-related preferences to the IESG for publication", set due date to August 2026 from August" (https://datatracker.ietf.org/wg/aipref/history/) [^ref-9]: IETF Datatracker, draft-keller-aipref-vocab, checked 2026-10-28: "Replaced Internet-Draft (candidate for aipref WG) Expired & archived Author Paul Keller Last updated 2025-04-10 (Latest revision 2025-03-30) Replaced by draft-ietf-aipref-vocab" (https://datatracker.ietf.org/doc/draft-keller-aipref-vocab/) [^ref-10]: Mark Nottingham, [ai-control] Adoption of draft-keller-aipref-vocab-01, ai-control mailing list, 2025-04-26, checked 2026-10-28: "your chairs believe there is rough consensus to adopt draft-keller-aipref-vocab-01 as the starting point of our vocabulary work." "Accordingly, we appoint Paul Keller and Martin Thomson as editors." (https://mailarchive.ietf.org/arch/msg/ai-control/LuWDC12gjlQ6Yj5eKN7ZkgbxopA/) [^ref-11]: P. Keller and M. Thomson, Proposal for an Opt-Out Vocabulary, draft-ietf-aipref-vocab-00, 1 May 2025, checked 2026-10-28: "This document proposes a standardized vocabulary of use cases that can be targeted when expressing machine-readable opt-outs related to Text and Data Mining (TDM) and AI training." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-00.txt) [^ref-12]: draft-ietf-aipref-vocab-01 (category table: tdm, ai, genai, search, inference), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-01.txt) [^ref-13]: draft-ietf-aipref-vocab-02 (category table: all, train-ai, train-genai, ai-use, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-02.txt) [^ref-14]: draft-ietf-aipref-vocab-03 (category table: bots, train-ai, train-genai, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-03.txt) [^ref-15]: draft-ietf-aipref-vocab-04 (category table: bots, train-ai, ai-output, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-04.txt) [^ref-16]: draft-ietf-aipref-vocab-05 (category table: train-ai, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-05.txt) [^ref-17]: draft-ietf-aipref-vocab-06 (category table: train-ai, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-06.txt) [^ref-18]: draft-ietf-aipref-vocab-07 (category table: train-ai, search), checked 2026-10-28: "Table 1 tabulates this mapping." (https://www.ietf.org/archive/id/draft-ietf-aipref-vocab-07.txt) [^ref-19]: G. Illyes (Google) and M. Thomson (Mozilla), Associating AI Usage Preferences with Content in HTTP, draft-ietf-aipref-attach-05, 19 August 2026, checked 2026-10-28: "Methods are defined for associating usage preferences with content that is obtained using the HTTP protocol. This document defines attachment methods using the Robots Exclusion Protocol and HTTP header fields." "This document updates RFC 9309 to allow for the inclusion of usage preferences." "The Content-Usage field is a structured field dictionary, as defined in Section 3.2 of [FIELDS]. This field follows the vocabulary and processing rules in [VOCAB]." (https://www.ietf.org/archive/id/draft-ietf-aipref-attach-05.txt) [^ref-20]: IETF Datatracker, draft-ietf-aipref-attach document page, checked 2026-10-28: "Associating AI Usage Preferences with Content in HTTP" (https://datatracker.ietf.org/doc/draft-ietf-aipref-attach/) [^ref-21]: IETF Datatracker, draft-ietf-aipref-attach history, checked 2026-10-28: "2026-05-01 04 (System) Document has expired" "2026-08-18 05 Martin Thomson New version available: draft-ietf-aipref-attach-05.txt" (https://datatracker.ietf.org/doc/draft-ietf-aipref-attach/history/) [^ref-22]: GitHub, ietf-wg-aipref/drafts repository, checked 2026-10-28: "AIPREF working drafts" (https://github.com/ietf-wg-aipref/drafts) [^ref-23]: Editor's copy of the vocabulary draft on GitHub Pages, checked 2026-10-28: "A Vocabulary For Expressing AI Usage Preferences" (https://ietf-wg-aipref.github.io/drafts/draft-ietf-aipref-vocab.html) [^ref-24]: Will Allen, Cloudflare Blog, Giving users choice with Cloudflare's new Content Signals Policy, 2025-09-24, checked 2026-10-28: "This policy defines three content signals - search, ai-input, and ai-train - and their relevance to crawlers." (https://blog.cloudflare.com/content-signals-policy/) [^ref-25]: Michael Tremante, [ai-control] Cloudflare's Content Signal Policy, ai-control mailing list, 2025-09-24, checked 2026-10-28: "We see this as an interim measure to address immediate needs, while work is done towards standardization." "We will continue to engage in this working group and hope we can achieve a consensus position and will revisit our policy once that has happened." (https://mailarchive.ietf.org/arch/msg/ai-control/EANb9b9bljOanLBFm5FRerYlxyI/) [^ref-26]: M. Tremante and L. Romm, draft-romm-aipref-contentsignals-00, individual Internet-Draft, 2025-10-01, checked 2026-10-28: "The proposal is for these categories to nest within the larger category of Automated Processing" (https://datatracker.ietf.org/doc/html/draft-romm-aipref-contentsignals-00) [^ref-27]: IETF Datatracker, draft-romm-aipref-contentsignals, checked 2026-10-28: "Expired Internet-Draft (individual) Expired & archived Authors Michael Tremante, Leah Romm" (https://datatracker.ietf.org/doc/draft-romm-aipref-contentsignals/) [^ref-28]: Bryan Becker, Cloudflare Blog, Have it both ways: stay discoverable in search while disallowing AI training, 2026-09-15, checked 2026-10-28: "As standards such as ai-prefs mature, we will revisit this approach." "Open standards such as ai-prefs will be an important part of making that possible." (https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/) [^ref-29]: Cloudflare press release, Cloudflare Helps End the Search-or-AI-Training Tradeoff, 2026-09-15, checked 2026-10-28: "Cloudflare is also an active participant in open standards work at the Internet Engineering Task Force (IETF), including "ai-prefs," a specification under development that would allow any website to express its AI access preferences in a standardized, portable way." "Today's controls are designed to work alongside these emerging standards." (https://www.cloudflare.com/press/press-releases/2026/cloudflare-helps-end-the-search-or-ai-training-tradeoff/) [^ref-30]: contentsignals.org, site description (meta description, undated), checked 2026-10-28: "An up-to-date guide to the IETF's proposed new AI Preferences (aipref): a new way for website publishers to control how automated systems use their content." (https://contentsignals.org/) [^ref-31]: SpinXO, robots.txt, checked 2026-10-28: "AI usage preference (draft-ietf-aipref-attach)." (https://www.spinxo.com/robots.txt) [^ref-32]: SpinXO, home page HTTP response header, checked 2026-10-28: "content-usage: train-ai=y, search=y" (https://www.spinxo.com/) [^ref-33]: Launchpad, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://launchpad.net/robots.txt) [^ref-34]: Launchpad Bugs, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://bugs.launchpad.net/robots.txt) [^ref-35]: Launchpad Code, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://code.launchpad.net/robots.txt) [^ref-36]: Launchpad Answers, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://answers.launchpad.net/robots.txt) [^ref-37]: Ubuntu Changelogs, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://changelogs.ubuntu.com/robots.txt) [^ref-38]: They Said So, robots.txt, checked 2026-10-28: "Content-Usage: ai=n" (https://theysaidso.com/robots.txt) [^ref-39]: IMozz, ai SiteReady, Content-Usage (aipref): robots.txt and HTTP header snippets, updated 2026-10-11, checked 2026-10-28: "I could not find a primary source from a major crawler operator saying it reads Content-Usage, so treat support as unknown and uneven." (https://www.ai-siteready.com/blog/content-usage-aipref-robots-txt-http) [^ref-40]: Mark Nottingham and Suresh Krishnan, IETF Blog, Enabling Publishers to Express Preferences for AI Crawlers: An Update on the AIPREF Working Group, 2025-10-30, checked 2026-10-28: "Accordingly, we made a Working Group Last Call on the documents in September." "The response was not one we anticipated: several participants raised fundamental issues about the nature of the Internet-Drafts (I-Ds), forcing the group to reconsider its approach." (https://www.ietf.org/blog/ai-pref-update/) [^ref-41]: AI Crawler Check, Content-Usage in robots.txt: The IETF AIPREF Standard Explained, 2026-10-18, checked 2026-10-28: "No major AI company has said publicly that its crawler reads Content-Usage yet, while every major one documents its tokens." (https://aicrawlercheck.com/blog/ietf-aipref-content-usage-robots-txt) [^ref-42]: Will Schweitzer, The Scholarly Kitchen, Guest Post — All this AI Signal and Noise: What Deserves Action Now, 2026-10-22, checked 2026-10-28: "On September 13, the AI preferences working group published a vocabulary with three verbs: training, use, and search." (https://scholarlykitchen.sspnet.org/2026/10/22/guest-post-all-this-ai-signal-and-noise-what-deserves-action-now/)