Can ChatGPT, Claude and Perplexity read your site?

We check your robots.txt, llms.txt, sitemap and the page you enter. We do not store the URL.

How the checker works

You enter your site address and the checker downloads four public files from our server: the page you entered, your robots.txt, your llms.txt and your sitemap. It does not run JavaScript, just like most AI crawlers, so you see your site the way they do.

For robots.txt it applies the same rules the bots follow (the RFC 9309 standard): each bot obeys only the group that names it and, if none does, the general «*» group. That is why a bot can be blocked even though your general rule allows it, or the other way around. The table shows, bot by bot, whether it can get in and which line of your file decides it.

Not every AI bot does the same job. Search bots (OAI-SearchBot, Claude-SearchBot and PerplexityBot) decide whether you show up in answers: blocking them leaves you out. Training bots (GPTBot, ClaudeBot, Google-Extended and CCBot) collect content to train models: blocking them is a legitimate choice and does not remove you from search answers. User-triggered bots (ChatGPT-User, Claude-User and Perplexity-User) visit a specific page when someone asks; OpenAI and Perplexity warn that theirs may not follow robots.txt.

Beyond robots.txt we check what can also keep you out: a noindex tag on the page or in the X-Robots-Tag header, very little text in the HTML without JavaScript (common on sites built only with React, Vue or misconfigured visual builders), the title, the description, the canonical, JSON-LD structured data and the sitemap.

llms.txt is shown as informational: it is a proposal to describe your site to language models, but no major search engine has confirmed it uses it. Having one will not make you show up, and not having one does not hurt you.

If a site blocks our server (a firewall, an anti-bot service or Cloudflare answering with a 403 error), the result says «could not verify» rather than marking your site as failing: we cannot know what a real bot sees. We do not store the URL you check or send it to analytics; the result is cached for a few hours so we do not download the same site again.

The full plan to get AI to recommend you: How to Get ChatGPT and Perplexity to Recommend Your Brand

Frequently asked questions

Does blocking GPTBot remove me from ChatGPT?

No. According to OpenAI, each bot is controlled separately: GPTBot collects content to train models and OAI-SearchBot decides whether you appear in ChatGPT search answers. You can block GPTBot and still show up if you allow OAI-SearchBot.

What does «your choice» mean on a blocked bot?

It means that bot is a training bot. Blocking it keeps your content out of model training and does not stop you from being cited in search answers, so we do not count it as an error: it is a legitimate choice.

Why does it say «could not verify»?

Because your server or CDN answered our checker with an error (for example 403), took longer than 5 seconds or did not answer. A real bot may get in, or it may be blocked too: check the bot settings of your hosting or Cloudflare.

Do I need an llms.txt file?

It is not essential. It is a proposal to guide language models, but no major search engine has confirmed it uses it. Focus first on letting search bots in and on content that can be read without JavaScript.

If everything passes, will ChatGPT recommend me?

Not necessarily. AI being able to read your site is the requirement; being cited depends on your content, on what other sites say about you and on your authority on the topic. This tool measures the first part, not the second.

Do you store the URL I check?

We do not store it in any database or send it to analytics. The result stays in the server cache for a few hours so that, if someone else checks the same site, we do not download it again.

Training program

Ready to turn your idea into a real project?

Transforma is the program where you will learn to create, execute and scale your project with clarity and method.

Discover the Transforma Program