AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#121
ui.com
No AI bot rules
Allows AI
#124
unity3d.com
No AI bot rules
Unknown
#127
sentry.io
No AI bot rules
Unknownllms.txt
#128
mozilla.org
No AI bot rules
Unknown
#129
reddit.com
No AI bot rules
Unknown
#134
googleadservices.com
No AI bot rules
Unknown
#135
vk.com
No AI bot rules
Unknown
#136
blogspot.com
No AI bot rules
Unknown
#137
discord.gg
No AI bot rules
Unknown
#138
intuit.com
No AI bot rules
Unknown
#142
epicgames.com
No AI bot rules
Unknown
#143
europa.eu
1 blocked
Unknown
#146
snapchat.com
35 blocked
Unknown
#154
apache.org
No AI bot rules
Unknown
#158
dropbox.com
No AI bot rules
Unknownllms.txt
#160
gravatar.com
8 blocked
Unknownllms.txt
#166
amazonvideo.com
33 blocked
Unknown
#171
pki.goog
No AI bot rules
Allows AI
#177
one.one
No AI bot rules
Allows AI
#179
nih.gov
No AI bot rules
Allows AI
#180
f5.com
No AI bot rules
Allows AI
#181
archive.org
No AI bot rules
Allows AI
#191
tumblr.com
10 blocked
Blocks AI
#194
paypal.com
No AI bot rules
Allows AIllms.txt
#196
kaspersky.com
17 allowed
Allows AIllms.txt
#202
nytimes.com
27 blocked
Blocks AI
#204
nist.gov
No AI bot rules
Allows AI
#217
reg.ru
No AI bot rules
Allows AI
#219
shopify.com
No AI bot rules
Allows AIllms.txt
#220
flickr.com
5 blocked
Blocks AI
#221
discord.com
No AI bot rules
Allows AI
#228
soundcloud.com
8 blocked
Unknown
#229
telekom.de
No AI bot rules
Allows AI
#230
chatgpt.com
10 blocked
Blocks AI
#231
adobe.io
No AI bot rules
Allows AI
#233
userapi.com
No AI bot rules
Allows AI
#235
miui.com
No AI bot rules
Unknown
#236
vungle.com
No AI bot rules
Allows AI
#238
cnn.com
37 blocked
Blocks AI
#239
w3.org
No AI bot rules
Allows AI
#247
theguardian.com
17 blocked
Blocks AI
#260
creativecommons.org
No AI bot rules
Allows AI
#261
forbes.com
14 blocked·1 allowed
Allows AI
#262
mts.ru
No AI bot rules
Allows AI
#263
t.co
No AI bot rules
Blocks AI
#265
salesforce.com
No AI bot rules
Unknownllms.txt
#266
twitch.tv
No AI bot rules
Allows AI
#271
bbc.com
22 blocked
Blocks AI
#274
sourceforge.net
No AI bot rules
Unknownllms.txt
#275
bbc.co.uk
22 blocked
Blocks AI
Showing 51-100 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy