Skip to content
Training crawler Run by OpenAI

What is GPTBot?

Short answer: GPTBot is OpenAI's crawler for model training. OpenAI says disallowing GPTBot indicates your content should not be used to train its generative AI foundation models. It is separate from OAI-SearchBot, which powers ChatGPT search, so you can block GPTBot and still be found and cited in ChatGPT.

GPTBot at a glance

Run by
OpenAI
Type
Training crawler
Used for
Training OpenAI's models
robots.txt name
GPTBot
Follows robots.txt
Yes
Last checked
18 November 2026
User agent
GPTBot The user agent contains the token GPTBot followed by a version number. OpenAI says version numbers may change.

What does GPTBot do?

GPTBot collects public web content that may be used to train OpenAI's generative AI foundation models, the models behind ChatGPT and OpenAI's API.

It does not decide whether you appear in ChatGPT search. That is OAI-SearchBot's job, and OpenAI says a webmaster can allow OAI-SearchBot to appear in search results while disallowing GPTBot.

What happens if you block GPTBot?

Disallowing GPTBot tells OpenAI your content should not be used in training its foundation models. It applies to future crawling; it does not remove anything from models already trained.

It does not remove you from ChatGPT search, and it does not stop ChatGPT-User fetching a page for a user who asks.

How do you allow or block GPTBot in robots.txt?

Does GPTBot follow robots.txt? Yes. GPTBot is one of the robots.txt tokens OpenAI documents for site owners, and each token is independent. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.

Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.

Block GPTBot

User-agent: GPTBot
Disallow: /

Allow GPTBot, keep /admin/ private

User-agent: GPTBot
Allow: /
Disallow: /admin/

Should you block GPTBot?

Our view: This is a business decision, not a visibility one. Some publishers that license their content block GPTBot; businesses that want future AI models to know their brand usually leave it allowed. Whatever you choose for GPTBot, keep OAI-SearchBot allowed if you want to be cited in ChatGPT.

How do you verify a real GPTBot request?

OpenAI publishes GPTBot's IP addresses at openai.com/gptbot.json. Check the source IP against that list.

GPTBot questions

What is the GPTBot user agent?
Requests contain GPTBot in the user agent. The user agent contains the token GPTBot followed by a version number. OpenAI says version numbers may change.
Does GPTBot follow robots.txt?
Yes. GPTBot is one of the robots.txt tokens OpenAI documents for site owners, and each token is independent. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.
Does blocking GPTBot remove me from ChatGPT?
Not from ChatGPT search. OpenAI controls search with OAI-SearchBot, so you can block GPTBot and still appear in ChatGPT search answers.
Does blocking GPTBot remove my content from existing models?
No. A robots.txt rule tells OpenAI not to use your content for training from then on; it does not change models that were already trained.
Should I block GPTBot?
Only if keeping your content out of model training matters more to you than having future models know your brand. It is a business choice; it does not affect ChatGPT search.
How do I check whether my site allows GPTBot?
Run your domain through the free ONEGO AI crawler checker. It reads your robots.txt and shows whether GPTBot and 15 other AI crawlers are allowed, blocked or partly restricted, and what each rule means.

Crawlers can read you. Does AI recommend you?

See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking