Skip to content
Search crawler Run by OpenAI

What is OAI-SearchBot?

Short answer: OAI-SearchBot is OpenAI's crawler for ChatGPT search. OpenAI uses it to surface websites in the search features of ChatGPT, and sites that block it are not shown in ChatGPT search answers, although they can still appear as navigational links. If you want ChatGPT to find, cite and link to you, keep OAI-SearchBot allowed.

OAI-SearchBot at a glance

Run by
OpenAI
Type
Search crawler
Used for
ChatGPT search
robots.txt name
OAI-SearchBot
Follows robots.txt
Yes
Last checked
18 November 2026
User agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot Example from OpenAI's documentation. OpenAI says the version number may change, and the string carries a robots.txt marker when the bot fetches robots.txt.

What does OAI-SearchBot do?

OpenAI describes OAI-SearchBot as the crawler used to surface websites in search results in ChatGPT's search features. When ChatGPT looks something up on the web and shows sources, OAI-SearchBot is how OpenAI knows your pages exist and what they say.

It is not a training crawler. OpenAI controls training with GPTBot, a separate token, so you can allow OAI-SearchBot to appear in ChatGPT search while disallowing GPTBot.

What happens if you block OAI-SearchBot?

OpenAI says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. In practice that means ChatGPT stops quoting and citing your pages when it searches the web, which is where most product and vendor recommendations with sources come from.

Blocking OAI-SearchBot does not stop ChatGPT-User, which fetches a page when a person asks ChatGPT to open it, and it does not change whether GPTBot collects training data.

How do you allow or block OAI-SearchBot in robots.txt?

Does OAI-SearchBot follow robots.txt? Yes. OAI-SearchBot is controlled with its own robots.txt group, separately from GPTBot. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.

Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.

Block OAI-SearchBot

User-agent: OAI-SearchBot
Disallow: /

Allow OAI-SearchBot, keep /admin/ private

User-agent: OAI-SearchBot
Allow: /
Disallow: /admin/

Should you block OAI-SearchBot?

Our view: Allow it if you want to be recommended in ChatGPT. It is the crawler that decides whether ChatGPT search can use your pages, and a blanket robots.txt rule or a strict firewall can block it without anyone noticing.

How do you verify a real OAI-SearchBot request?

OpenAI publishes the IP addresses OAI-SearchBot crawls from at openai.com/searchbot.json. Match the source IP against that list, because a user agent alone is easy to fake.

OAI-SearchBot questions

What is the OAI-SearchBot user agent?
OpenAI lists it as: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot. Example from OpenAI's documentation. OpenAI says the version number may change, and the string carries a robots.txt marker when the bot fetches robots.txt.
Does OAI-SearchBot follow robots.txt?
Yes. OAI-SearchBot is controlled with its own robots.txt group, separately from GPTBot. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.
What is the difference between OAI-SearchBot and GPTBot?
OAI-SearchBot finds pages for ChatGPT search; GPTBot collects content that may be used to train OpenAI's models. OpenAI controls them separately, so you can allow OAI-SearchBot and block GPTBot.
How long does it take for an OAI-SearchBot change to work?
OpenAI says it can take about 24 hours from a robots.txt update for its systems to adjust.
Can my site appear in ChatGPT if I block OAI-SearchBot?
Only in a limited way. OpenAI says opted out sites are not shown in ChatGPT search answers but can still appear as navigational links.
How do I check whether my site allows OAI-SearchBot?
Run your domain through the free ONEGO AI crawler checker. It reads your robots.txt and shows whether OAI-SearchBot and 15 other AI crawlers are allowed, blocked or partly restricted, and what each rule means.

Crawlers can read you. Does AI recommend you?

See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking