ChatGLM-Spider
Tier 3Collects training data for ChatGLM, China's leading conversational AI.
ChatGLM-Spider๐ฏWhat is ChatGLM-Spider?
ChatGLM-Spider is an AI training crawler operated by Zhipu AI. Collects data to train AI models.
Trains ChatGLM series models. Major competitor to ChatGPT in China.
Content won't train ChatGLM models.
Backed by Tsinghua University. ChatGLM is one of China's most advanced LLMs.
๐ขAbout Zhipu AI
Zhipu AI operates 1 known bot for AI model training. Their service reaches 10M+ users in China.
๐ก๏ธChatGLM-Spider robots.txt Configuration
Control ChatGLM-Spider access to your website using robots.txt directives.
Block ChatGLM-Spider
To completely block ChatGLM-Spider from crawling your site:
User-agent: ChatGLM-Spider
Disallow: /Allow ChatGLM-Spider Full Access
To explicitly allow ChatGLM-Spider to crawl your entire site:
User-agent: ChatGLM-Spider
Allow: /Selective Access for ChatGLM-Spider
To allow ChatGLM-Spider but restrict certain directories:
User-agent: ChatGLM-Spider
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /โ ChatGLM-Spider respects robots.txt directives.
ChatGLM-Spider User-Agent String
The user-agent token for ChatGLM-Spider is:
ChatGLM-Spider๐Who Blocks ChatGLM-Spider?
Check Your Site's AI Policy
See if you're blocking or allowing ChatGLM-Spider and other AI crawlers.