AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#1,002
primevideo.com
33 blocked
Blocks AI
#1,005
riotgames.com
No AI bot rules
Allows AI
#1,006
washington.edu
No AI bot rules
Allows AI
#1,007
recaptcha.net
No AI bot rules
Allows AI
#1,008
academia.edu
5 blocked·8 allowed
Blocks AI
#1,011
mayoclinic.org
No AI bot rules
Allows AI
#1,012
disneyplus.com
2 blocked
Unknown
#1,014
threads.com
10 blocked
Blocks AI
#1,016
webmd.com
4 blocked
Unknown
#1,017
usps.com
No AI bot rules
Allows AI
#1,019
linode.com
No AI bot rules
Allows AI
#1,020
lefigaro.fr
16 blocked
Blocks AI
#1,026
synology.com
No AI bot rules
Unknown
#1,029
apnews.com
12 blocked
Unknown
#1,032
livejournal.com
No AI bot rules
Unknown
#1,034
nbcnews.com
21 blocked
Unknown
#1,043
salesforceliveagent.com
No AI bot rules
Unknown
#1,044
singular.net
No AI bot rules
Unknownllms.txt
#1,045
dns-shop.ru
No AI bot rules
Unknown
#1,051
themeforest.net
1 blocked
Unknown
#1,054
nintendo.com
21 blocked
Blocks AI
#1,055
welt.de
52 blocked
Blocks AI
#1,056
onlyfans.com
No AI bot rules
Allows AI
#1,057
flashtalking.com
No AI bot rules
Allows AI
#1,058
pornhub.com
8 blocked
Unknown
#1,061
agoda.com
No AI bot rules
Allows AI
#1,064
tenor.com
No AI bot rules
Allows AI
#1,066
healthline.com
12 blocked
Blocks AI
#1,070
clever.com
No AI bot rules
Allows AIllms.txt
#1,074
qualtrics.com
No AI bot rules
Allows AIllms.txt
#1,075
iso.org
7 blocked
Unknown
#1,078
ubnt.com
No AI bot rules
Allows AI
#1,079
www.linkedin.com
24 blocked
Unknown
#1,083
bild.de
55 blocked
Blocks AI
#1,084
gdemoideti.ru
No AI bot rules
Allows AI
#1,086
hindustantimes.com
No AI bot rules
Allows AI
#1,087
globalsign.com
No AI bot rules
Allows AI
#1,089
sedo.com
No AI bot rules
Allows AI
#1,093
zoom.com
No AI bot rules
Unknown
#1,094
amazon.com.br
33 blocked
Blocks AI
#1,095
docker.io
No AI bot rules
Allows AI
#1,097
bankofamerica.com
No AI bot rules
Allows AI
#1,099
rbc.ru
No AI bot rules
Allows AI
#1,101
openstreetmap.org
No AI bot rules
Allows AI
#1,105
figma.com
13 blocked
Unknown
#1,106
discogs.com
1 blocked
Unknown
#1,107
ebay.co.uk
8 blocked
Unknown
#1,109
nationalgeographic.com
No AI bot rules
Allows AI
#1,110
genius.com
18 blocked
Blocks AI
#1,114
kick.com
No AI bot rules
Allows AI
Showing 401-450 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy