🤖
User-Agent Token
omgilibotRespects robots.txt
YesImpact Level
Notable
10M+ users - Regional/specialized AI companies
Estimated Reach
10M+ users - Regional/specialized AI companies
🎯What is Omgilibot?
Omgilibot is an AI training crawler operated by Webz.io. Collects data to train AI models.
🚫 What Happens If You Block
Same as omgili. Block both user-agents for complete Webz.io coverage.
💡 Good to Know
Legacy user-agent. Same customers as omgili: Hootsuite, Sprinklr, NetBase.
🏢About Webz.io
🛡️omgilibot robots.txt Configuration
Control omgilibot access to your website using robots.txt directives.
Block omgilibot
To completely block Omgilibot from crawling your site:
User-agent: omgilibot
Disallow: /Allow omgilibot Full Access
To explicitly allow Omgilibot to crawl your entire site:
User-agent: omgilibot
Allow: /Selective Access for omgilibot
To allow Omgilibot but restrict certain directories:
User-agent: omgilibot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Omgilibot respects robots.txt directives.
omgilibot User-Agent String
The user-agent token for Omgilibot is:
omgilibot🌐Who Blocks Omgilibot?
Blocking (49 sites)
01net.com0kkbd.com10best.com11freunde.de12bajeevip.com12g555.com13abc.com13g555.com13x555.com15min.lt1777sx.com1881.no20minutos.es21viptaka.com24bdbajee.com26superph.com299bet.com355jilipark.vip3dvf.com3rr.com4029tv.com47news.jp499bet.bingo4goodhosting.com4p.de4players.de4vid.top52216452.com55brlbet.com57bet777.win588ku.com5gbet51.com5gbet.com678bd44.com6abc.com777jaya.net777tiger888.com7788bet.com77hbajee.com78112277.com7c7778.com7p777.bet888jogo.net888pg-ox.vip888win7.vip888win.com88betpk.com88fb.net8newsnow.com
Explicitly Allowing (1 sites)
🔗Other Webz.io Bots
Check Your Site's AI Policy
See if you're blocking or allowing Omgilibot and other AI crawlers.