Question 1

Does archives.gov block AI crawlers?

Accepted Answer

No, archives.gov does not block any AI crawlers in its robots.txt.

Question 2

Does archives.gov block ChatGPT?

Accepted Answer

No, archives.gov allows GPTBot (OpenAI's crawler) to access the site.

Question 3

Does archives.gov block Claude?

Accepted Answer

No, archives.gov allows ClaudeBot (Anthropic's crawler) to access the site.

Question 4

Does archives.gov have an AI policy?

Accepted Answer

archives.gov has a open AI policy as determined by its robots.txt rules. It blocks 0 AI crawlers.

archives.gov