What is OAI-SearchBot?
Short answer: OAI-SearchBot is OpenAI's crawler for ChatGPT search. OpenAI uses it to surface websites in the search features of ChatGPT, and sites that block it are not shown in ChatGPT search answers, although they can still appear as navigational links. If you want ChatGPT to find, cite and link to you, keep OAI-SearchBot allowed.
OAI-SearchBot at a glance
- Run by
- OpenAI
- Type
- Search crawler
- Used for
- ChatGPT search
- robots.txt name
-
OAI-SearchBot - Follows robots.txt
- Yes
- Last checked
- 18 November 2026
- User agent
-
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbotExample from OpenAI's documentation. OpenAI says the version number may change, and the string carries a robots.txt marker when the bot fetches robots.txt.
What does OAI-SearchBot do?
OpenAI describes OAI-SearchBot as the crawler used to surface websites in search results in ChatGPT's search features. When ChatGPT looks something up on the web and shows sources, OAI-SearchBot is how OpenAI knows your pages exist and what they say.
It is not a training crawler. OpenAI controls training with GPTBot, a separate token, so you can allow OAI-SearchBot to appear in ChatGPT search while disallowing GPTBot.
What happens if you block OAI-SearchBot?
OpenAI says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. In practice that means ChatGPT stops quoting and citing your pages when it searches the web, which is where most product and vendor recommendations with sources come from.
Blocking OAI-SearchBot does not stop ChatGPT-User, which fetches a page when a person asks ChatGPT to open it, and it does not change whether GPTBot collects training data.
How do you allow or block OAI-SearchBot in robots.txt?
Does OAI-SearchBot follow robots.txt? Yes. OAI-SearchBot is controlled with its own robots.txt group, separately from GPTBot. OpenAI says it can take about 24 hours after you update robots.txt for its systems to adjust.
Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.
Block OAI-SearchBot
User-agent: OAI-SearchBot
Disallow: / Allow OAI-SearchBot, keep /admin/ private
User-agent: OAI-SearchBot
Allow: /
Disallow: /admin/ Should you block OAI-SearchBot?
Our view: Allow it if you want to be recommended in ChatGPT. It is the crawler that decides whether ChatGPT search can use your pages, and a blanket robots.txt rule or a strict firewall can block it without anyone noticing.
How do you verify a real OAI-SearchBot request?
OpenAI publishes the IP addresses OAI-SearchBot crawls from at openai.com/searchbot.json. Match the source IP against that list, because a user agent alone is easy to fake.
Related AI crawlers
-
ChatGPT-UserOpenAI · User fetcher Opens a page when a ChatGPT user asks it to, for example to read a link. -
GPTBotOpenAI · Training crawler Collects content that may be used to train OpenAI's AI models. -
GooglebotGoogle · Search crawler Crawls the web for Google Search, including AI Overviews and AI Mode. -
BingbotMicrosoft · Search crawler Crawls the web for Bing, whose index also grounds Copilot answers.
Readable is not the same as recommended: see whether ChatGPT names your brand with the free ChatGPT visibility checker. See every AI crawler in one table, check your own robots.txt with the free AI crawler checker, or give AI tools a clean summary of your site with the llms.txt generator.
OAI-SearchBot questions
What is the OAI-SearchBot user agent?
Does OAI-SearchBot follow robots.txt?
What is the difference between OAI-SearchBot and GPTBot?
How long does it take for an OAI-SearchBot change to work?
Can my site appear in ChatGPT if I block OAI-SearchBot?
How do I check whether my site allows OAI-SearchBot?
Crawlers can read you. Does AI recommend you?
See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking