AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#1,115
worldbank.org
No AI bot rules
Allows AI
#1,116
bitrix24.ru
No AI bot rules
Allows AI
#1,118
w3schools.com
No AI bot rules
Allows AI
#1,122
change.org
7 blocked
Unknown
#1,124
arcgis.com
No AI bot rules
Allows AI
#1,125
chess.com
No AI bot rules
Allows AI
#1,126
sportradar.com
No AI bot rules
Allows AI
#1,128
richaudience.com
No AI bot rules
Allows AI
#1,129
redd.it
No AI bot rules
Allows AI
#1,131
huffpost.com
24 blocked
Blocks AI
#1,133
mailchi.mp
No AI bot rules
Blocks AI
#1,135
selectel.ru
No AI bot rules
Allows AI
#1,140
epicgames.dev
No AI bot rules
Unknown
#1,142
whitehouse.gov
No AI bot rules
Allows AI
#1,143
wps.com
No AI bot rules
Allows AI
#1,144
biblegateway.com
No AI bot rules
Allows AI
#1,146
theatlantic.com
16 blocked
Blocks AI
#1,150
frontiersin.org
No AI bot rules
Allows AI
#1,151
readthedocs.io
No AI bot rules
Unknown
#1,152
smartthings.com
No AI bot rules
Allows AI
#1,153
chaturbate.com
1 blocked
Unknown
#1,154
character.ai
No AI bot rules
Allows AI
#1,155
superhosting.bg
No AI bot rules
Allows AI
#1,157
deloitte.com
No AI bot rules
Allows AI
#1,162
patreon.com
8 blocked
Unknown
#1,165
otto.de
6 blocked
Unknown
#1,169
airbnb.com
9 blocked
Unknown
#1,173
www.gov.br
No AI bot rules
Allows AI
#1,174
rambler.ru
1 allowed
Allows AI
#1,175
kslawin.com
2 blocked
Unknownllms.txt
#1,176
pbs.org
3 blocked
Unknown
#1,178
utorrent.com
No AI bot rules
Unknown
#1,179
epa.gov
No AI bot rules
Allows AI
#1,180
onet.pl
No AI bot rules
Allows AI
#1,182
parklogic.com
No AI bot rules
Allows AI
#1,184
tiktokw.us
No AI bot rules
Unknown
#1,187
classlink.com
No AI bot rules
Allows AIllms.txt
#1,188
jetbrains.com
No AI bot rules
Allows AI
#1,190
thenai.org
No AI bot rules
Allows AI
#1,191
repubblica.it
23 blocked·1 allowed
Blocks AIllms.txt
#1,192
daum.net
1 blocked
Blocks AI
#1,193
ebay.de
8 blocked
Unknown
#1,194
typeform.com
No AI bot rules
Allows AIllms.txt
#1,196
jd.com
No AI bot rules
Allows AI
#1,197
netgear.com
No AI bot rules
Allows AIllms.txt
#1,198
kleinanzeigen.de
4 allowed
Allows AI
#1,204
pikabu.ru
No AI bot rules
Unknown
#1,205
mercadolivre.com.br
8 blocked·1 allowed
Unknown
#1,207
amazon.com.au
33 blocked
Blocks AI
#1,209
kwai.com
2 blocked
Allows AIllms.txt
Showing 451-500 of 500 sites
Need access to more sites?
We have data on 1M+ websites. Contact us for enterprise access.
DM us on Twitter →Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy