User-Agent Token
PanguBotRespects robots.txt
UnknownImpact Level
Notable
10M+ users - Regional/specialized AI companies
Estimated Reach
10M+ users - Regional/specialized AI companies
๐ฏWhat is PanguBot?
PanguBot is an AI training crawler operated by Huawei. Collects data to train AI models.
๐ How Your Data is Used
Pre-training for Pangu foundation models.
๐ซ What Happens If You Block
Content won't train Huawei's Pangu AI models.
๐ก Good to Know
Pangu models power Huawei's enterprise and consumer AI features.
๐ขAbout Huawei
๐ก๏ธPanguBot robots.txt Configuration
Control PanguBot access to your website using robots.txt directives.
Block PanguBot
To completely block PanguBot from crawling your site:
User-agent: PanguBot
Disallow: /Allow PanguBot Full Access
To explicitly allow PanguBot to crawl your entire site:
User-agent: PanguBot
Allow: /Selective Access for PanguBot
To allow PanguBot but restrict certain directories:
User-agent: PanguBot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /PanguBot User-Agent String
The user-agent token for PanguBot is:
PanguBot๐Who Blocks PanguBot?
Blocking (50 sites)
01net.com15min.lt1881.no20minutos.es4p.de4players.de588ku.comabendblatt.dea.coad-italia.itadmagazine.fradweek.comaftenbladet.noaftenposten.noaftonbladet.seaftvnews.comagrarheute.comalfemminile.comallabolag.seallgaeuer-zeitung.deall-in.deallure.comamarillo.comamazon.aeamazonalexa.comamazon.caamazon.clamazon.co.jpamazon.comamazon.com.auamazon.com.bramazon.com.coamazon.com.mxamazon.com.tramazon.co.ukamazon.co.zaamazon.deamazon.egamazon.esamazon.framazon.ieamazon.inamazon.itamazon.jpamazon.nlamazon.plamazon.saamazon.seamazon.sgamazonsilk.com
๐Other Huawei Bots
Check Your Site's AI Policy
See if you're blocking or allowing PanguBot and other AI crawlers.