Question 1

Does mongodb.org block AI crawlers?

Accepted Answer

Yes, mongodb.org blocks 1 AI crawlers in its robots.txt. Its overall stance is selective.

Question 2

Does mongodb.org block ChatGPT?

Accepted Answer

No, mongodb.org allows GPTBot (OpenAI's crawler) to access the site.

Question 3

Does mongodb.org block Claude?

Accepted Answer

No, mongodb.org allows ClaudeBot (Anthropic's crawler) to access the site.

Question 4

Does mongodb.org have an AI policy?

Accepted Answer

mongodb.org has a selective AI policy as determined by its robots.txt rules and publishes an llms.txt file. It blocks 1 AI crawlers.

mongodb.org