Skip to main content

Paper | Rogerson: Guardian News & Media Draft Paper on an AI.txt Protocol
slides-aicontrolws-guardian-news-media-draft-paper-on-an-aitxt-protocol-00

Slides IAB Workshop on AI-CONTROL (aicontrolws) Team
Title Paper | Rogerson: Guardian News & Media Draft Paper on an AI.txt Protocol
Abstract
Robots.txt (internet standard RFC 9309) is a text file which allows website owners to define
how they are accessed, if at all, by automated clients. …
Robots.txt (internet standard RFC 9309) is a text file which allows website owners to define
how they are accessed, if at all, by automated clients. In the context of controlling access
to scraping for AI training, we note that the RFC 9309 refers to automated clients as being
crawlers
State Active
Other versions pdf
Last updated 2024-09-09

slides-aicontrolws-guardian-news-media-draft-paper-on-an-aitxt-protocol-00
Not available as plain text. Download as PDF.