AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#884
aniview.com
No AI bot rules
Allows AI
#887
anydesk.com
No AI bot rules
Unknown
#889
freepik.com
No AI bot rules
Allows AI
#892
sagepub.com
12 blocked
Blocks AI
#894
nypost.com
18 blocked
Unknown
#897
amazon.in
33 blocked
Blocks AI
#899
xiaohongshu.com
1 blocked
Unknown
#902
gumgum.com
No AI bot rules
Allows AI
#906
no-ip.com
No AI bot rules
Allows AI
#909
vkontakte.ru
No AI bot rules
Allows AI
#911
tencent.com
No AI bot rules
Allows AI
#914
pendo.io
No AI bot rules
Allows AI
#916
creativecdn.com
No AI bot rules
Blocks AI
#917
zillow.com
No AI bot rules
Allows AI
#918
homedepot.com
No AI bot rules
Allows AI
#920
buzzfeed.com
24 blocked
Blocks AI
#923
amazon.es
33 blocked
Blocks AI
#928
adform.net
No AI bot rules
Blocks AI
#932
xvideos.com
No AI bot rules
Allows AI
#933
allaboutcookies.org
No AI bot rules
Unknownllms.txt
#936
shopee.co.id
1 blocked
Allows AI
#945
mixpanel.com
No AI bot rules
Allows AI
#948
networkadvertising.org
No AI bot rules
Allows AI
#950
amazon.it
33 blocked
Blocks AI
#951
theverge.com
14 blocked·2 allowed
Blocks AI
#953
fiverr.com
No AI bot rules
Allows AI
#955
newsweek.com
16 blocked
Unknown
#957
prnewswire.com
No AI bot rules
Allows AIllms.txt
#959
zoho.com
No AI bot rules
Allows AI
#960
xerox.com
No AI bot rules
Unknown
#961
stripchat.com
No AI bot rules
Unknown
#962
seznam.cz
No AI bot rules
Allows AI
#969
xbox.com
No AI bot rules
Allows AI
#971
discordapp.com
No AI bot rules
Allows AI
#973
people.com
13 blocked
Blocks AI
#974
latimes.com
6 blocked
Unknown
#977
bandcamp.com
8 blocked
Unknown
#978
nikkei.com
26 blocked
Unknown
#985
investopedia.com
12 blocked
Blocks AI
#986
rakuten.com
No AI bot rules
Allows AI
#989
hbr.org
4 blocked
Unknown
#990
cursor.sh
No AI bot rules
Allows AIllms.txt
#991
life360.com
No AI bot rules
Unknown
#992
vivo.com.cn
No AI bot rules
Allows AI
#993
maricopa.gov
No AI bot rules
Allows AI
#996
fda.gov
No AI bot rules
Allows AI
#997
python.org
No AI bot rules
Allows AI
#999
ameblo.jp
No AI bot rules
Allows AI
#1,000
datadoghq.com
No AI bot rules
Allows AIllms.txt
#1,001
merriam-webster.com
No AI bot rules
Allows AI
Showing 351-400 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy