AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#1
google.com
No AI bot rules
Allows AI
#3
microsoft.com
No AI bot rules
Allows AI
#4
facebook.com
10 blocked
Blocks AI
#5
cloudflare.com
No AI bot rules
Allows AI
#7
mail.ru
No AI bot rules
Blocks AI
#8
apple.com
No AI bot rules
Allows AI
#9
youtube.com
No AI bot rules
Allows AI
#12
instagram.com
10 blocked
Blocks AI
#13
dzen.ru
No AI bot rules
Allows AI
#14
gstatic.com
No AI bot rules
Blocks AI
#18
twitter.com
3 blocked
Blocks AI
#21
linkedin.com
24 blocked
Allows AI
#23
fbcdn.net
10 blocked
Blocks AI
#26
amazon.com
33 blocked
Blocks AI
#33
wikipedia.org
No AI bot rules
Allows AI
#35
github.com
1 blocked
Allows AI
#37
doubleclick.net
No AI bot rules
Allows AI
#38
netflix.com
2 allowed
Blocks AI
#39
bing.com
No AI bot rules
Allows AI
#40
whatsapp.net
8 blocked
Unknown
#43
digicert.com
No AI bot rules
Allows AIllms.txt
#45
fastly.net
No AI bot rules
Allows AI
#48
wordpress.org
No AI bot rules
Allows AI
#52
youtu.be
No AI bot rules
Allows AI
#54
pinterest.com
18 blocked
Blocks AI
#56
icloud.com
No AI bot rules
Allows AI
#60
yahoo.com
18 blocked
Blocks AI
#61
whatsapp.com
8 blocked
Unknown
#69
x.com
3 blocked
Blocks AI
#71
ntp.org
No AI bot rules
Allows AI
#73
spotify.com
No AI bot rules
Allows AI
#76
gandi.net
No AI bot rules
Allows AI
#78
tiktok.com
22 blocked
Blocks AI
#80
vimeo.com
11 blocked
Blocks AI
#83
adobe.com
No AI bot rules
Allows AIllms.txt
#85
roblox.com
No AI bot rules
Allows AI
#87
cloudflare.net
No AI bot rules
Allows AI
#89
tiktokv.com
No AI bot rules
Unknown
#96
wa.me
No AI bot rules
Allows AI
#99
qq.com
No AI bot rules
Unknown
#100
google-analytics.com
No AI bot rules
Allows AI
#101
nginx.org
No AI bot rules
Allows AI
#102
office365.com
No AI bot rules
Blocks AI
#105
zoom.us
No AI bot rules
Allows AI
#107
opera.com
No AI bot rules
Allows AIllms.txt
#108
samsung.com
5 blocked
Unknown
#110
bit.ly
No AI bot rules
Allows AI
#112
baidu.com
No AI bot rules
Blocks AI
#117
yandex.ru
1 blocked
Allows AI
#118
wordpress.com
No AI bot rules
Allows AIllms.txt
Showing 1-50 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy