AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#384
media.net
No AI bot rules
Allows AI
#387
forter.com
No AI bot rules
Allows AI
#388
etsy.com
No AI bot rules
Allows AI
#389
bilibili.com
4 allowed
Blocks AI
#390
php.net
No AI bot rules
Allows AI
#393
ivi.ru
No AI bot rules
Allows AI
#395
ezvizlife.com
No AI bot rules
Unknown
#396
wiley.com
No AI bot rules
Allows AI
#398
nature.com
20 blocked
Blocks AI
#403
tradingview.com
No AI bot rules
Allows AI
#408
mikrotik.com
No AI bot rules
Unknown
#410
weebly.com
No AI bot rules
Unknown
#411
slack.com
No AI bot rules
Unknownllms.txt
#418
washingtonpost.com
17 blocked
Unknown
#420
cdc.gov
No AI bot rules
Unknown
#423
checkpoint.com
No AI bot rules
Unknown
#426
go.com
2 blocked
Unknown
#428
wsj.com
15 blocked
Unknown
#432
grammarly.com
No AI bot rules
Unknown
#436
un.org
No AI bot rules
Unknown
#438
naver.com
No AI bot rules
Unknown
#440
launchdarkly.com
No AI bot rules
Unknown
#441
uber.com
No AI bot rules
Unknown
#443
dailymail.co.uk
47 blocked
Unknown
#447
aliyun.com
No AI bot rules
Allows AI
#450
bloomberg.com
14 blocked
Blocks AI
#459
cloudns.net
No AI bot rules
Allows AI
#461
telegraph.co.uk
44 blocked
Blocks AI
#462
vk.ru
No AI bot rules
Blocks AI
#463
stanford.edu
No AI bot rules
Allows AI
#464
cornell.edu
No AI bot rules
Allows AI
#466
nvidia.com
1 blocked
Allows AIllms.txt
#467
dailymotion.com
No AI bot rules
Allows AIllms.txt
#470
afternic.com
No AI bot rules
Allows AI
#471
tp-link.com
No AI bot rules
Allows AI
#480
espn.com
9 blocked
Unknown
#483
vivoglobal.com
No AI bot rules
Allows AI
#490
expireddomains.com
No AI bot rules
Allows AI
#492
temu.com
12 blocked
Blocks AI
#493
cookielaw.org
8 blocked
Unknown
#499
plesk.com
No AI bot rules
Allows AIllms.txt
#500
aliexpress.com
No AI bot rules
Allows AI
#502
nasa.gov
No AI bot rules
Allows AI
#505
unsplash.com
4 blocked
Unknown
#507
globo.com
3 blocked
Unknown
#509
businessinsider.com
3 blocked
Unknown
#512
dell.com
1 blocked
Unknownllms.txt
#519
google.com.br
No AI bot rules
Unknown
#520
wp.com
No AI bot rules
Unknownllms.txt
#522
independent.co.uk
No AI bot rules
Unknown
Showing 151-200 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy