Question 1

Does cstx.gov block AI crawlers?

Accepted Answer

No, cstx.gov does not block any AI crawlers in its robots.txt.

Question 2

Does cstx.gov block ChatGPT?

Accepted Answer

No, cstx.gov allows GPTBot (OpenAI's crawler) to access the site.

Question 3

Does cstx.gov block Claude?

Accepted Answer

No, cstx.gov allows ClaudeBot (Anthropic's crawler) to access the site.

Question 4

Does cstx.gov have an AI policy?

Accepted Answer

cstx.gov has a open AI policy as determined by its robots.txt rules. It blocks 0 AI crawlers.

cstx.gov