AI Bot Policies
See how websites handle AI crawlers like GPTBot and ClaudeBot
#523
gnu.org
1 blocked
Unknown
#525
amazon.de
33 blocked
Unknown
#530
teamviewer.com
No AI bot rules
Allows AI
#537
netangels.ru
No AI bot rules
Unknown
#538
taobao.com
No AI bot rules
Allows AI
#539
163.com
No AI bot rules
Allows AI
#542
cookiedatabase.org
No AI bot rules
Unknown
#544
steamcommunity.com
No AI bot rules
Unknown
#545
statista.com
1 blocked
Allows AI
#546
calendly.com
2 blocked
Unknownllms.txt
#549
duckduckgo.com
1 blocked
Unknown
#552
trustpilot.com
25 blocked
Blocks AI
#553
duolingo.com
No AI bot rules
Unknown
#558
quora.com
17 blocked
Blocks AI
#560
pixabay.com
6 blocked
Unknown
#561
ipify.org
No AI bot rules
Allows AI
#562
cnbc.com
19 blocked
Unknown
#565
ietf.org
No AI bot rules
Allows AI
#568
aol.com
18 blocked
Allows AI
#571
walmart.com
No AI bot rules
Allows AI
#573
goodreads.com
2 blocked
Unknown
#575
foxnews.com
No AI bot rules
Allows AI
#577
addtoany.com
No AI bot rules
Allows AI
#578
zendesk.com
No AI bot rules
Unknown
#579
name.com
No AI bot rules
Allows AI
#580
notamedia.ru
No AI bot rules
Allows AI
#582
mediatek.com
No AI bot rules
Unknown
#585
cdnvideo.ru
No AI bot rules
Allows AI
#586
line.me
No AI bot rules
Allows AI
#589
eventbrite.com
No AI bot rules
Allows AI
#594
gitlab.com
No AI bot rules
Allows AI
#596
giphy.com
1 blocked
Allows AI
#597
yahoo.co.jp
2 blocked
Unknown
#598
speedtest.net
1 blocked
Unknown
#602
hcaptcha.com
No AI bot rules
Allows AI
#606
supercell.com
No AI bot rules
Allows AI
#610
eset.com
No AI bot rules
Allows AI
#612
amzn.to
No AI bot rules
Allows AI
#613
wired.com
26 blocked
Blocks AI
#615
amplitude.com
No AI bot rules
Allows AI
#616
mysql.com
No AI bot rules
Allows AI
#621
imgsmail.ru
No AI bot rules
Blocks AI
#625
ip-api.com
No AI bot rules
Allows AI
#630
behance.net
19 blocked
Unknown
#631
uol.com.br
39 blocked
Blocks AI
#633
indiatimes.com
No AI bot rules
Allows AI
#635
google.de
No AI bot rules
Allows AI
#636
firefox.com
No AI bot rules
Allows AI
#638
ys7.com
No AI bot rules
Allows AI
#648
visualstudio.com
No AI bot rules
Allows AI
Showing 201-250 of 500 sites
Check any website's AI policy
See if they block GPTBot, ClaudeBot, and other AI crawlers.
Check AI Policy