imageSpider
Tier 3📚 AI Trainingby ByteDance ↗
ByteDance's image collection bot for visual AI training.
User-Agent Token
imageSpiderRespects robots.txt
UnknownImpact Level
Notable
10M+ users - Regional/specialized AI companies
Estimated Reach
10M+ users - Regional/specialized AI companies
🎯What is imageSpider?
imageSpider is an AI training crawler operated by ByteDance. Collects data to train AI models.
📊 How Your Data is Used
Image data for visual AI model training.
🚫 What Happens If You Block
ByteDance can't collect images from your site for AI training.
💡 Good to Know
Separate from Bytespider which collects text. Part of ByteDance's AI training infrastructure.
🏢About ByteDance
🛡️imageSpider robots.txt Configuration
Control imageSpider access to your website using robots.txt directives.
Block imageSpider
To completely block imageSpider from crawling your site:
User-agent: imageSpider
Disallow: /Allow imageSpider Full Access
To explicitly allow imageSpider to crawl your entire site:
User-agent: imageSpider
Allow: /Selective Access for imageSpider
To allow imageSpider but restrict certain directories:
User-agent: imageSpider
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /imageSpider User-Agent String
The user-agent token for imageSpider is:
imageSpider🌐Who Blocks imageSpider?
Blocking (50 sites)
adweek.comarkansasonline.comaskmen.combabycenter.combabycentre.co.ukbarcelona.catbattlecreekenquirer.combrainerddispatch.comchiemgau24.dechrispederick.comcity-data.comcome-on.decoupons.decptdb.cadailyamerican.comdailylocal.comecho24.deeldiadevalladolid.comemmasdiary.co.ukeurogamer.eseurogamer.neteurogamer.ptextremetech.comfdlreporter.comfnp.defr.defuldaerzeitung.degadsdentimes.comgamesindustry.bizgeek.comgiessener-allgemeine.degld.nlgofeminin.dehaiku-os.orghealthecareers.comheavengames.comhna.dehoerzu.dehoustonpublicmedia.orghowlongtobeat.comign.comingame.deinsidehalton.comkreiszeitung.del1nieuws.nllifehacker.comludwigshafen24.demabumbe.commapgenie.iomashable.com
🔗Other ByteDance Bots
Check Your Site's AI Policy
See if you're blocking or allowing imageSpider and other AI crawlers.