Blog / Myth vs. Reality

The llms.txt Myth: Why That File Won't Get You in ChatGPT

Some AI visibility tools are selling llms.txt generation as a magic ticket to AI discovery. Here's what's actually happening—and what works instead.

January 19, 2026 5 min read

If you've been researching AI visibility tools, you've probably seen some promising "llms.txt generation" as a feature. The pitch sounds compelling: add a special file to your website and AI assistants will discover your business.

There's just one problem: it doesn't work.

What is llms.txt?

The concept is simple and well-intentioned. Just like robots.txt tells search engine crawlers how to index your site, llms.txt is a proposed standard for telling AI systems about your business.

A typical llms.txt file might look like this:

# MyBusiness llms.txt
name: Acme Plumbing
description: Licensed plumbers serving Columbus, Ohio since 1985
services: emergency repairs, water heaters, drain cleaning
location: Columbus, OH
contact: (614) 555-0123

The idea is that ChatGPT, Claude, or Perplexity would crawl your site, find this file, and use it to recommend you to users.

It's a nice idea. But that's not how any of these AI systems actually work.

Why llms.txt Doesn't Work (Yet)

Here's the uncomfortable truth that some AI visibility vendors won't tell you:

ChatGPT and Claude don't crawl the web

These models are trained on massive datasets compiled months or years before you talk to them. They learned about businesses from:

  • Common Crawl snapshots (web archives from specific dates)
  • Wikipedia and other reference sources
  • News articles and publications
  • Public datasets and documentation

When someone asks ChatGPT "Who's the best plumber in Columbus?", it's not visiting your website to check. It's drawing on patterns learned during training—patterns that were locked in place long before you added any llms.txt file.

Perplexity does search, but not via llms.txt

Perplexity is different—it actually searches the web in real-time. But it uses its own search infrastructure, not a robots.txt-style file. It's looking at your actual content, your authority, and what other sources say about you.

Adding an llms.txt file to your site doesn't give Perplexity any special signal it wasn't already getting from your regular pages.

No major AI has adopted the standard

As of early 2026, no major AI system has officially announced support for llms.txt. It remains a proposal, not a standard that's actually being used.

Why Some Vendors Push It Anyway

So if llms.txt doesn't work, why are some AI visibility tools selling it as a feature?

A few reasons:

  • It's easy to deliver. Generating a text file takes seconds. It looks like a tangible deliverable even if it does nothing.
  • It sounds technical. Most business owners don't know how LLMs work. A "robots.txt for AI" sounds plausible.
  • Future-proofing claims. "When AI systems adopt this standard, you'll be ready!" Maybe. But you're paying now for something that might never happen.

What Actually Affects AI Visibility

If llms.txt isn't the answer, what is? Here's what actually influences whether AI systems mention your business:

1. Being in the training data

AI models learn from what they were trained on. If your business is mentioned in authoritative sources—news articles, industry publications, Wikipedia references—it's more likely to appear in AI responses.

2. Strong traditional SEO

For AI systems that do search (like Perplexity), your ranking in search results matters. If you show up on page one of Google, you're more likely to be included in AI-generated answers.

3. Citations and mentions

AI systems learn from the collective web. Being mentioned, reviewed, and cited by other legitimate sources builds the kind of authority that makes it into training data.

4. Google Business Profile

For local businesses, your Google Business Profile feeds into multiple systems. Voice assistants, map apps, and some AI searches pull from this data.

Track What Matters

We built Scout to track where your brand actually appears across AI engines, Google Search, Local Maps, and Voice Assistants. Four channels, one dashboard, no snake oil.

We don't sell llms.txt generation because it doesn't work. Instead, we show you the reality of your visibility—and that's the first step to improving it.

"The goal isn't to game AI systems with magic files. It's to build the kind of authority and presence that AI systems naturally recognize."

When the industry changes—and it will—we'll adapt. But we won't sell you features that don't deliver results today.

See where you actually appear

Track your real visibility across AI, Search, Maps, and Voice.

Check Your Visibility
← Back to Blog