AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#749
cnet.com
2 blocked
Unknown
#750
atlassian.com
1 blocked
Allows AI
#755
yelp.com
14 blocked
Blocks AI
#756
free.fr
1 blocked·1 allowed
Unknown
#760
ikea.com
No AI bot rules
Allows AI
#768
squarespace.com
23 blocked
Blocks AI
#770
onetrust.com
No AI bot rules
Allows AIllms.txt
#771
imgur.com
No AI bot rules
Allows AI
#772
comcast.com
No AI bot rules
Unknown
#776
surveymonkey.com
No AI bot rules
Allows AI
#777
nike.com
No AI bot rules
Unknown
#780
substack.com
No AI bot rules
Allows AI
#784
brave.com
No AI bot rules
Unknown
#786
cbsnews.com
1 blocked
Unknown
#788
conviva.com
No AI bot rules
Unknown
#789
fontawesome.com
No AI bot rules
Unknown
#792
viber.com
No AI bot rules
Unknown
#794
jotform.com
14 blocked
Unknown
#798
optimizely.com
No AI bot rules
Unknownllms.txt
#802
shutterstock.com
6 blocked
Unknown
#803
ipinfo.io
No AI bot rules
Unknown
#807
amazon.fr
33 blocked
Unknown
#810
ted.com
15 blocked·1 allowed
Unknown
#813
deepl.com
1 blocked
Unknown
#814
newrelic.com
No AI bot rules
Unknown
#816
wattpad.com
1 blocked
Unknown
#817
erome.com
No AI bot rules
Allows AI
#818
elpais.com
No AI bot rules
Unknown
#822
techcrunch.com
13 blocked
Unknown
#824
avito.ru
No AI bot rules
Unknown
#828
hihonorcloud.com
No AI bot rules
Blocks AI
#829
shopee.com.br
1 blocked
Allows AI
#832
amazon.ca
33 blocked
Blocks AI
#833
google.co.uk
No AI bot rules
Allows AI
#841
redhat.com
No AI bot rules
Allows AI
#842
pinimg.com
18 blocked
Blocks AI
#843
rackspace.com
No AI bot rules
Allows AI
#846
klaviyo.com
2 allowed
Allows AI
#847
onlinepbx.ru
No AI bot rules
Allows AI
#853
cambridge.org
1 blocked
Allows AI
#854
marriott.com
No AI bot rules
Unknown
#858
atlassian.net
1 blocked
Unknown
#866
unesco.org
No AI bot rules
Allows AI
#869
mediafire.com
1 blocked
Unknown
#870
fb.com
10 blocked
Blocks AI
#871
spiegel.de
21 blocked
Blocks AI
#877
ring.com
No AI bot rules
Allows AI
#879
mailchimp.com
No AI bot rules
Allows AIllms.txt
#881
asus.com
No AI bot rules
Allows AI
#883
lemonde.fr
37 blocked
Blocks AI
Showing 301-350 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy