World editions

Where the web is
building its toll booth.

AI-crawler blocking is not global — it's national. The same scan shows France gating most of its web from AI, while Russia leaves it wide open. Here is the map, by country, refreshed weekly.

Baseline · — · Tranco top 2,000, segmented by country-code domain

Share of sites blocking at least one AI crawler

France leads. Russia opts out of opting out.

Global baseline (.com/.org and other generic domains): —

—

Per-crawler detail

Who each country locks out.

Block rates by individual crawler tell a sharper story than the headline: some countries gate training bots while leaving search crawlers alone, others block everything or nothing.

Country	GPTBot	ClaudeBot	Google-Ext.	Any AI