What is GPTBot?
Short answer: GPTBot is OpenAI's crawler for model training. OpenAI says disallowing GPTBot indicates your content should not be used to train its generative AI foundation models. It is separate from OAI-SearchBot, which powers ChatGPT search, so you can block GPTBot and still be found and cited in ChatGPT.
GPTBot at a glance
- Run by
- OpenAI
- Type
- Training crawler
- Used for
- Training OpenAI's models
- robots.txt name
-
GPTBot - Follows robots.txt
- Yes
- Last checked
- 18 November 2026
- User agent
-
GPTBotThe user agent contains the token GPTBot followed by a version number. OpenAI says version numbers may change.
What does GPTBot do?
GPTBot collects public web content that may be used to train OpenAI's generative AI foundation models, the models behind ChatGPT and OpenAI's API.
It does not decide whether you appear in ChatGPT search. That is OAI-SearchBot's job, and OpenAI says a webmaster can allow OAI-SearchBot to appear in search results while disallowing GPTBot.
What happens if you block GPTBot?
Disallowing GPTBot tells OpenAI your content should not be used in training its foundation models. It applies to future crawling; it does not remove anything from models already trained.
It does not remove you from ChatGPT search, and it does not stop ChatGPT-User fetching a page for a user who asks.
How do you allow or block GPTBot in robots.txt?
Does GPTBot follow robots.txt? Yes. GPTBot is one of the robots.txt tokens OpenAI documents for site owners, and each token is independent. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.
Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.
Block GPTBot
User-agent: GPTBot
Disallow: / Allow GPTBot, keep /admin/ private
User-agent: GPTBot
Allow: /
Disallow: /admin/ Should you block GPTBot?
Our view: This is a business decision, not a visibility one. Some publishers that license their content block GPTBot; businesses that want future AI models to know their brand usually leave it allowed. Whatever you choose for GPTBot, keep OAI-SearchBot allowed if you want to be cited in ChatGPT.
How do you verify a real GPTBot request?
OpenAI publishes GPTBot's IP addresses at openai.com/gptbot.json. Check the source IP against that list.
Related AI crawlers
-
OAI-SearchBotOpenAI · Search crawler Indexes pages so ChatGPT search can find, show and link to them. -
ChatGPT-UserOpenAI · User fetcher Opens a page when a ChatGPT user asks it to, for example to read a link. -
ClaudeBotAnthropic · Training crawler Collects content that may be used to train Anthropic's AI models. -
CCBotCommon Crawl · Training crawler Builds the open Common Crawl dataset, which many AI models are trained on.
Readable is not the same as recommended: see whether ChatGPT names your brand with the free ChatGPT visibility checker. See every AI crawler in one table, check your own robots.txt with the free AI crawler checker, or give AI tools a clean summary of your site with the llms.txt generator.
GPTBot questions
What is the GPTBot user agent?
Does GPTBot follow robots.txt?
Does blocking GPTBot remove me from ChatGPT?
Does blocking GPTBot remove my content from existing models?
Should I block GPTBot?
How do I check whether my site allows GPTBot?
Crawlers can read you. Does AI recommend you?
See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking