Enter a domain. We check it against this week's scan of the Tranco top 50,000 — your AI-crawler policy fingerprint, how you compare to the web, a benchmark price, and the exact files to start charging. No signup needed.
checking index…
Step 1 · your domain
Your AI-crawler policy fingerprint ·
—
of 18 tracked crawlers blocked in robots.txt
—
of the scanned web blocks fewer crawlers than you
—
Tranco rank
Step 2 · the honest revenue estimate
$0.02
Suggested band for your tier: — — our judgment, anchored to the highest price we actually observe anyone charging: $0.50 / crawl (stackoverflow.com → ClaudeBot, reproduced weekly).
Today · few buyers actually pay
$0 – $0
Assumes 0.5–2 % of AI crawl requests come from crawlers that pay at posted rates. That share is honest: even on the largest bot-paywall network, roughly 4 in 5 sites have never earned a dollar.
If agentic payments mature
$0
Assumes 20 % of AI requests pay — the scenario Cloudflare's default-block era (from Sept 15, 2026) is pushing the market toward. Not a promise. A ceiling worth positioning for now, while setup costs you an afternoon.
What is measured vs. what you chose: your policy fingerprint, percentile and rank are measured by our own crawler this week. The revenue figures are an estimate built from the traffic and content type you selected — we do not measure your traffic. Where the ratios come from: publisher networks measured ~1 AI crawler visit per 31 human visits in Q4 2025 (up 60 % in six months); we scale that by your content type. Most tools inflate this. We track the crawl economy for a living — the honest answer is that today's revenue is small for almost everyone, and the option value of being set up early is the real prize.
Step 3 · get told when this changes
AI-crawler policy is not static — domains flip between blocked and allowed every week. We scan the whole top 50,000 weekly. If anything changes for your domain, you get one email naming exactly what changed. Nothing else.
Step 3 · start charging in one afternoon
If you're on Cloudflare (about 1 in 5 sites are): enable AI Crawl Control, join the Pay Per Crawl beta, and set your price — minimum $0.01, one price for all charged crawlers. Cloudflare collects and pays out; you never touch the plumbing.
If you're a publisher with real bot traffic: TollBit runs a bot paywall on ~7,000 sites — you keep 100 % of your posted rate; AI buyers pay TollBit's fee on top.
Everyone: declare machine-readable terms with RSL and robots.txt so your price and policy are visible to every compliant crawler. Paste the two files below — generated for your domain at your chosen price.
robots.txt — add these lines
rsl.xml — save at your site root, licence terms machines can read
Get your numbers weekly
Your fingerprint and the benchmarks above move every week as the web repricess itself. The Weekly Crawl delivers the movers — which domains changed policy, block-rate shifts, observed prices — plus an instant free data sample.
Want every domain's row, 53 country editions and the API? Terminal — €79/mo.