Skip to main content

Crawler best practices
draft-illyes-aipref-cbcp-04

Document Type Expired Internet-Draft (individual)
Expired & archived
Authors Gary Illyes , Mirja Kühlewind , AJ Kohn
Last updated 2026-10-11 (Latest revision 2026-04-09)
RFC stream (None)
Intended RFC status (None)
Formats
Stream Stream state (No stream defined)
Consensus boilerplate Unknown
RFC Editor Note (None)
IESG IESG state Expired
Telechat date (None)
Responsible AD (None)
Send notices to (None)

This Internet-Draft is no longer active. A copy of the expired Internet-Draft is available in these formats:

Abstract

This document describes best practices for web crawlers. Discussion Venues This note is to be removed before publishing as an RFC. Source for this draft and an issue tracker can be found at https://github.com/garyillyes/cbcp.

Authors

Gary Illyes
Mirja Kühlewind
AJ Kohn

(Note: The e-mail addresses provided for the authors of this Internet-Draft may no longer be valid.)