Pay per Crawl

Cloudflare's technical framework letting publishers charge AI crawlers for access, built on the HTTP 402 status code. Content owners get a third option beyond allow-or-block: charge. Cloudflare handles payments and authentication, preventing spoofing.

Benefits & outcomes

Positions crawler access as a programmatic market rather than a legal fight.


Publisher / company: Cloudflare
Date of mention: 22/07/2025
Source: https://blog.cloudflare.com/introducing-pay-per-crawl/