What is Bingbot?
Short answer: Bingbot is Microsoft's crawler for Bing search. Content in Bing's index can also be used in Copilot answers and grounding, so Bingbot access matters for Microsoft's AI experiences too. Microsoft controls AI use of content with separate preferences, and is replacing its old NoArchive and NoCache tags with new AI Training and AI Grounding preferences in 2027.
Bingbot at a glance
- Run by
- Microsoft
- Type
- Search crawler
- Used for
- Bing search and Copilot
- robots.txt name
-
Bingbot - Follows robots.txt
- Yes
- Last checked
- 18 November 2026
- User agent
-
bingbot/2.0; +http://www.bing.com/bingbot.htmBing lists desktop and mobile user agent strings that include this, with the browser version updated over time.
What does Bingbot do?
Bingbot crawls the web to build Bing's search index. Bing's guidelines describe its content controls as also governing Copilot responses and grounding results, so pages Bingbot cannot read cannot inform those answers either.
Many sites watch only Googlebot. Checking Bingbot access, and submitting a sitemap in Bing Webmaster Tools, is a cheap way to make sure Microsoft's AI experiences can use your pages.
What happens if you block Bingbot?
Blocking Bingbot removes your pages from Bing, and with that from the Copilot answers that draw on Bing's index.
To limit AI use without leaving Bing, Microsoft offers content preferences instead. Today the NOARCHIVE and NOCACHE meta tags control use in Copilot; Microsoft announced in October 2026 that new AI Training and AI Grounding preferences will replace them, taking effect as it crawls from 1 February 2027.
How do you allow or block Bingbot in robots.txt?
Does Bingbot follow robots.txt? Yes. Bingbot follows robots.txt. Microsoft's AI preferences control how crawled content is used, not crawling, so an AI preference cannot override a robots.txt rule that blocks Bingbot.
Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.
Block Bingbot
User-agent: Bingbot
Disallow: / Allow Bingbot, keep /admin/ private
User-agent: Bingbot
Allow: /
Disallow: /admin/ Should you block Bingbot?
Our view: Keep Bingbot allowed. If you want to limit how Microsoft uses your content for AI, set the new AI Training and AI Grounding preferences rather than blocking the crawler.
What are Microsoft's new AI Training and AI Grounding preferences?
Announced in October 2026, they let you decide separately whether your content can be used to train AI models and whether it can inform AI generated answers. AI Training can be set for a whole site or path in robots.txt and per page; AI Grounding is set per page with a meta tag or HTTP header. Microsoft says they follow the IETF working syntax and will replace NoArchive and NoCache for these uses. It asks publishers to set them by 1 March 2027. See Bing's New AI preferences page for the exact syntax before you deploy.
How do you verify a real Bingbot request?
Bing warns that user agent strings can be faked. Use its Verify Bingbot tool (in Bing Webmaster Tools, or the public version at bing.com/toolbox/verify-bingbot) to check whether an IP address belongs to Bingbot.
Related AI crawlers
-
OAI-SearchBotOpenAI · Search crawler Indexes pages so ChatGPT search can find, show and link to them. -
GooglebotGoogle · Search crawler Crawls the web for Google Search, including AI Overviews and AI Mode. -
PerplexityBotPerplexity · Search crawler Indexes pages so Perplexity can show and link them in its answers. -
Claude-SearchBotAnthropic · Search crawler Indexes pages to improve the search results Claude gives users.
See every AI crawler in one table, check your own robots.txt with the free AI crawler checker, or give AI tools a clean summary of your site with the llms.txt generator.
Bingbot questions
What is the Bingbot user agent?
Does Bingbot follow robots.txt?
Does Copilot use Bingbot?
How do I stop Copilot using my content without leaving Bing?
When do Microsoft's new AI preferences start?
How do I check whether my site allows Bingbot?
Crawlers can read you. Does AI recommend you?
See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking