User-Agent Token
bedrockbotRespects robots.txt
YesImpact Level
Notable
10M+ users - Regional/specialized AI companies
Estimated Reach
10M+ users - Regional/specialized AI companies
🎯What is Bedrock Bot?
Bedrock Bot is an AI training crawler operated by Amazon. Collects data to train AI models.
📊 How Your Data is Used
Training data for custom models built on AWS Bedrock.
🚫 What Happens If You Block
Content won't be used for custom enterprise AI applications on AWS.
💡 Good to Know
AWS Bedrock is Amazon's enterprise AI platform. Used by large corporations.
🏢About Amazon
🛡️bedrockbot robots.txt Configuration
Control bedrockbot access to your website using robots.txt directives.
Block bedrockbot
To completely block Bedrock Bot from crawling your site:
User-agent: bedrockbot
Disallow: /Allow bedrockbot Full Access
To explicitly allow Bedrock Bot to crawl your entire site:
User-agent: bedrockbot
Allow: /Selective Access for bedrockbot
To allow Bedrock Bot but restrict certain directories:
User-agent: bedrockbot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Bedrock Bot respects robots.txt directives.
bedrockbot User-Agent String
The user-agent token for Bedrock Bot is:
bedrockbot🌐Who Blocks Bedrock Bot?
Blocking (47 sites)
4p.de4players.deabendblatt.deallgaeuer-zeitung.deall-in.dearkansasonline.comasitavsen.comaugsburger-allgemeine.deautobild.debarcelona.catbbv-net.debfmtv.combild.debrainerddispatch.combraunschweiger-zeitung.debrigitte.debsc.esbusinessinsider.debz-berlin.dechrispederick.comcidadeverde.comcomputerbild.decptdb.cadailymail.comdailymail.co.ukdeanza.eduderwesten.deevergreen-marine.comexpresso.ptfaithful-to-nature.co.zafearproject.rufranceculture.frfranceinter.frfuturezone.degala.degentoo.orggofeminin.degonintendo.comgramophone.co.ukhaiku-os.orgharvardartmuseums.orgheavengames.comhellwegeranzeiger.dehinative.comhoerzu.deimageshack.comimageshack.us
Explicitly Allowing (3 sites)
🔗Other Amazon Bots
Check Your Site's AI Policy
See if you're blocking or allowing Bedrock Bot and other AI crawlers.