OAI-SearchBot

OAI-SearchBot serves ChatGPT's search and source function, not model training. OpenAI notes that website owners should not block this bot if their content is to appear as a source in ChatGPT Search.

To be visible in ChatGPT, allow the bot in robots.txtThe robots.txt is a publicly accessible text file in a site's root directory. It tells crawlers which URLs they may fetch and therefore controls crawling.Open glossary entry →:

• User-agent: OAI-SearchBot
• Allow: /

A common mistake is checking only GPTBot. For ChatGPT visibility, however, OAI-SearchBot and ChatGPT-User are decisive. If OAI-SearchBotOAI-SearchBot is the crawler documented by OpenAI for ChatGPT Search. It fetches content so that public websites can appear as a source in ChatGPT summaries, snippets and answers.Open glossary entry → is allowed in robots.txt but blocked by a firewall or CDNA content delivery network (CDN) is a network of distributed servers that delivers static content closer to the user, reducing loading times.Open glossary entry → with status code 403, content is still missing. Server logs should therefore be checked for actual bot access.