Is your flooring website hidden from ChatGPT? A five-minute check any owner can do

OpenAI writes that sites which block its reading program, OAI-SearchBot, will not be shown in ChatGPT search answers. One text file decides it, and an owner can read that file in a browser. Here is how to check it, what each line means, the setting to look at if Cloudflare protects your site, and what to do next.

Is your flooring website hidden from ChatGPT? A five-minute check any owner can do

A flooring company can write the best pages in its city and still never appear in a ChatGPT search answer, because of one line in one small text file. The check takes five minutes, needs no tools, and any owner can do it from a phone.

Why does one file matter?

ChatGPT reads websites for its search answers with a program that OpenAI calls OAI-SearchBot. OpenAI's own documentation says that OAI-SearchBot "is used to surface websites in search results in ChatGPT's search features", and then, in one sentence: "Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers."

A site opts out in a file called robots.txt. Every website can have one, at the same place: the website address followed by /robots.txt. The file tells each reading program, by name, which parts of the site it may visit. Google uses the same file for its own reader, Googlebot, and lists "ensuring that crawling is allowed in robots.txt" among the basics for its AI answers.

How do you read the file?

Open a browser and type your address followed by /robots.txt, for example yourflooring.com/robots.txt. You will see a few lines of plain text, or a page that says the file does not exist. No file means nothing is blocked.

The lines come in groups. Each group starts with a User-agent line, which names a program, and continues with Disallow or Allow lines, which say which parts of the site that program may visit.

What you seeWhat it means
User-agent: OAI-SearchBot then Disallow: /ChatGPT's search reader is blocked from the whole site
User-agent: * then Disallow: /Every program is blocked, including Google and ChatGPT, unless a group names it separately
User-agent: GPTBot then Disallow: /OpenAI's training program is blocked; ChatGPT search is unaffected
User-agent: * then Disallow: /wp-admin/Only the admin area is blocked; this is normal
Disallow: with nothing after itNothing is blocked

The second row is the dangerous one. A site that was blocked while it was being built can keep this line by mistake after launch, and it hides the site from Google as well.

What do the three OpenAI programs do?

OpenAI names three programs in its documentation, and each has a separate setting.

  • OAI-SearchBot reads websites for ChatGPT's search answers. This is the one a flooring company should allow.
  • GPTBot is used, in OpenAI's words, "to make our generative AI foundation models more useful and safe". A company may block it if it prefers; it does not affect ChatGPT search.
  • ChatGPT-User visits a page when a person asks ChatGPT to open it. OpenAI writes that it "is not used for crawling the web in an automatic fashion."

OpenAI says that "each setting is independent of the others", and that a change can take "~24 hours" to apply.

What if Cloudflare protects your site?

Cloudflare is a service that sits in front of a website to speed it up and protect it from attacks. It has its own settings for AI programs, separate from robots.txt.

Cloudflare's documentation, updated on November 2, 2026, calls the setting "AI Crawler and Agent access policies". It groups AI programs by what they do, and defines Search as "crawlers that collect or index your content to answer questions about it later." For new domains, it says, "Search, Agents, and Training use Allow (do not block) by default."

A site set up earlier, or by someone who changed the setting, may differ. If your site uses Cloudflare, ask whoever manages it to confirm that the Search policy is set to Allow. Other security and hosting services can have similar settings, so ask the same question of yours.

What should the file say?

For most flooring companies a short file is enough. The example below is for a WordPress site, whose admin area sits at /wp-admin/; other website builders use other addresses. It allows every program, keeps the admin area private, and tells programs where the list of pages is. If you want to keep your pages out of AI training, add the GPTBot group; ChatGPT search remains allowed.

User-agent: *
Disallow: /wp-admin/

User-agent: GPTBot
Disallow: /

Sitemap: https://www.yourflooring.com/sitemap.xml

Do not edit the file yourself unless you manage the site. Send the lines you found to whoever does, and ask them to allow OAI-SearchBot and Googlebot. Check the file again the next day.

Is allowing the program enough?

Allowing the program makes the site eligible to be shown. What the assistant then writes depends on what it finds on the site and about it.

We saw this in our test of Gemini on November 8, 2026: 20 questions about flooring companies in 10 cities (the full test). The answers were built mostly from the companies' own websites, 281 of 390 statements, and the facts repeated were plain ones: the year started, the towns served, the floors installed, the crews, the warranty, the estimate and the steps of the job. We have not yet run the same test on ChatGPT, so we report only what OpenAI documents.

The next steps are in our flooring company marketing hub, starting with how ChatGPT and Gemini choose a flooring company and what a flooring website needs.

At Licheo we build and run websites for small businesses so they get found on Google and in AI answers; contact us for pricing. The free Get Found Check reads your homepage and returns a letter grade, with a separate grade for readiness for AI assistants, in under 60 seconds.

Sources

  1. Overview of OpenAI Crawlers, OpenAI, accessed November 8, 2026.
  2. AI features and your website, Google Search Central, last updated 2025-12-10, accessed November 8, 2026.
  3. AI Crawler and Agent access policies, Cloudflare, last updated November 2, 2026, accessed November 8, 2026.
  4. Licheo test of Gemini 2.5 Pro with grounding in Google Search: 20 questions about flooring companies in 10 cities, run on November 8, 2026.

Frequently asked questions

How do I check if my website blocks ChatGPT?

Open your website address followed by /robots.txt in a browser, for example yoursite.com/robots.txt. Look for a group that starts with User-agent: OAI-SearchBot, or User-agent: * for every program, followed by Disallow: /. Either one blocks OpenAI's search reader from the whole site. OpenAI writes that sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers.

What is OAI-SearchBot?

OAI-SearchBot is the program OpenAI uses to read websites for ChatGPT's search features. OpenAI's documentation says it is used to surface websites in search results in ChatGPT's search features, and that sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers. It is separate from GPTBot, which OpenAI uses to improve its AI models.

Can I block GPTBot and still appear in ChatGPT answers?

Yes, according to OpenAI. GPTBot is used to make its AI models more useful and safe, OAI-SearchBot reads websites for ChatGPT search, and OpenAI writes that each setting is independent of the others. A site can block GPTBot in robots.txt and still allow OAI-SearchBot. OpenAI says changes can take about 24 hours to apply in its systems.

Does Cloudflare block ChatGPT by default?

Not for new domains, according to Cloudflare's documentation updated on November 2, 2026. Its AI Crawler and Agent access policies setting groups AI programs by what they do, and for new domains Search, Agents and Training use Allow by default. A site set up earlier, or one where someone changed the setting, may differ, so an owner whose site uses Cloudflare should check the Search policy is set to Allow.

What does Disallow mean in a robots.txt file?

Disallow is the instruction that tells a reading program which part of a site it should not visit. Disallow: / with a single slash covers the whole site. Disallow: /admin/ covers only addresses that begin with /admin/. An empty Disallow: line blocks nothing. The instruction applies to the programs named in the User-agent line above it.

Does Google need anything special to show my site in AI Overviews?

Google says there are no additional requirements to appear in AI Overviews or AI Mode, nor other special optimizations necessary. A page must be indexed and eligible to be shown in Google Search with a snippet. Google lists allowing crawling in robots.txt, and by any CDN or hosting infrastructure, among the basics, so the same file matters for Google as well.

If my site allows OAI-SearchBot, will ChatGPT recommend my flooring company?

Allowing it makes the site eligible to be shown, and the answer depends on what ChatGPT finds. In our test of Gemini on November 8, 2026, the answers about flooring companies were built mostly from facts on company websites, such as the towns served, the floors installed and the warranty, and from reviews on sites like Houzz. ChatGPT has not yet been tested by us.

Who should change the robots.txt file on a small business website?

Whoever manages the website: the company that built it, the hosting company or the person who has the login. Send them the exact line you found and ask them to allow OAI-SearchBot and Googlebot, then check the file again in your browser the next day.

Rather not do this yourself?

We can simply do it for you

Everything in this article, the website fixes, the content, being found on Google and inside AI assistants like ChatGPT, is work that big companies pay a whole team of specialists for. Licheo does it for small businesses, every month. You never learn a tool, and you are never handed a to-do list. See what that team costs a big company.