Stop Adding llms.txt — ChatGPT Isn't Reading It (And Here's the Data)

1 day ago
7 min read

Last updated: June 2026

No. An llms.txt file is not currently a ranking factor for Google, and there is no evidence that it helps ChatGPT, Gemini or Perplexity recommend your business.

It may become useful in the future. But right now, the AI tools it's built for rarely look at it. If your goal is to be found and recommended by AI search, there are far more effective things to spend your time on than this file. This article explains what llms.txt actually does, what the research shows, and what genuinely improves your visibility in AI search in 2026.

Quick Answer

An llms.txt file does not currently improve Google rankings, and there is no evidence it increases visibility in AI search platforms such as ChatGPT, Gemini or Perplexity. Google has publicly stated it does not use llms.txt, and independent studies show major AI crawlers rarely request the file. For most businesses, creating helpful content, demonstrating real expertise and building authority remain far more important for AI visibility.

Abstract data streams flowing toward a website while one isolated file stays disconnected, illustrating how AI search tools bypass llms.txt.

llms.txt definition

llms.txt is a proposed website file that helps large language models (LLMs) discover and understand the important content on a website. It's designed to give AI systems a curated list of pages, documentation or resources, similar to how a sitemap helps search engines navigate a site.

The idea is reasonable. It's a bit like leaving a one-page summary at the front desk instead of making every visitor wander through the entire building.

The problem isn't the idea. The problem is that the visitors it's meant for mostly aren't picking it up.

The uncomfortable truth: the AI tools ignore it

This is where the hype falls apart. When researchers checked their website logs to see whether AI systems were actually reading the file, the answer was almost always no.

A study by OtterlyAI tracked an llms.txt file over three months and more than sixty thousand AI-bot visits. The file was requested in just 0.1% of them. A separate, much larger analysis by Limy, examining over 500 million AI-crawler requests, reached the same conclusion: the file is barely touched by the AI search engines that decide whether your business gets mentioned in an answer.

This isn't a measurement glitch, and it isn't bad luck. None of the major AI platforms have publicly confirmed that llms.txt influences citations, recommendations or rankings within their systems. In practice, AI systems appear to rely far more on accessible content, trusted sources and citation-worthy information than on the presence of an llms.txt file.

What does Google say about llms.txt?

Directly to the point. Google Search Advocate John Mueller has publicly stated that Google does not use llms.txt and compared it to an old SEO trick (the keywords meta tag) that stopped working years ago. Google's Gary Illyes confirmed the same: Google does not support the file and has no plans to.

So if your reason for adding llms.txt is "this will help me rank in Google or get recommended by ChatGPT," that reason doesn't hold up today.

Where it can quietly backfire

Adding a harmless text file sounds risk-free. The trouble starts with how a lot of people are told to do it.

A common piece of advice is to create a separate copy of every single page on your site in a simpler format, so AI can read them. If those copies end up visible to Google, you've now created two versions of every page: the real one and the copy.

Google doesn't like seeing the same content twice. It can get confused about which version to show, and your original pages, the ones you actually want people to find, can lose ground in the search results.

So the worst-case version of "just add it, it can't hurt" is the one where it does.

llms.txt vs. what actually improves your AI visibility

Here's the honest comparison. This is where your time is better spent:

Factor	Helps Google	Helps AI Visibility
llms.txt	No evidence	Limited evidence
Helpful, original content	Yes	Yes
Strong E-E-A-T (expertise & trust)	Yes	Yes
Structured data	Yes	Yes
Brand mentions on trusted sites	Yes	Yes
Expert authorship	Yes	Yes
Fast, well-organised website	Yes	Yes

Notice that llms.txt is the only row without a clear "yes." Everything that genuinely moves the needle in AI search is about being trustworthy and easy to read, not about a hidden file.

When llms.txt genuinely makes sense

To be fair, the file isn't pointless. It's just being sold for the wrong job.

It earns its place in two specific situations:

You sell software or technical products. AI coding assistants like Cursor, GitHub Copilot and Claude Code routinely fetch llms.txt when pointed at a documentation site.
Companies like Stripe and Cloudflare ship one so those tools get accurate information instead of inventing things that don't exist. That's a real, working use today.
You run an online store that AI shopping assistants might browse. As more people ask AI to "find me running shoes under 150 euro that ship by Friday," a clean, machine-readable list of your products and prices helps those assistants find and recommend yours.

Both of these are about making your information accurate and easy for machines to read, not about magically boosting your visibility. The pattern even has a name in the industry: it's a "business-to-agent" surface, the layer where AI agents act on your customers' behalf, rather than a search-ranking lever.

How do you get recommended by ChatGPT instead?

This is the part that matters. Being recommended in AI search isn't about a file. It comes down to the same foundations that make you trustworthy to a human:

Publish original, expert content that answers the real questions your customers ask, in plain language.
Answer those questions directly. Clear answers and clean structure are easy for an AI to lift and cite without guessing.
Build authoritative citations and mentions from websites people already trust.
Keep your business information consistent everywhere it appears online.
Make your content easy to quote with direct definitions and a logical structure.
Run a fast, well-organised website that both people and machines can move through easily.

None of that fits in a text file. All of it is what we cover in our work on getting your business found in ChatGPT, getting cited by Perplexity, and the wider field of Generative Engine Optimization (GEO).

If your rankings look stable but your traffic is slipping, that's a different and more urgent signal. We explain what's behind it in why your impressions are up but your clicks are down.

So should you add it? A simple rule

If you want to be found and recommended by AI search tools: llms.txt is not your lever. Skip it for now and focus on the foundations above.
If you sell software or run a product catalogue: the basic version is worth setting up, carefully, so you avoid the duplicate-content trap.
If someone is charging you a lot of money to "implement llms.txt for AI visibility": that's your signal to ask harder questions.

It's a twenty-minute, low-cost task with unproven payoff. It is not a priority, and it is definitely not the thing standing between you and getting found.

Text graphic reading "AI isn't reading your llms.txt" over abstract data streams, illustrating that AI crawlers ignore the file.

Key Takeaways

llms.txt is not a Google ranking factor.
There is currently no evidence that llms.txt improves visibility in ChatGPT, Gemini or Perplexity.
Google has publicly stated it does not use llms.txt.
Incorrect implementations can create duplicate-content risks.
Helpful content, authority and trust remain the strongest drivers of AI visibility.

Frequently asked questions

Does llms.txt help my Google rankings?

No. Google has publicly stated it doesn't use the file. Your Google visibility depends on the quality, structure and authority of your actual pages.

Does ChatGPT use llms.txt?

There's no evidence it does. Studies of real AI-crawler behaviour show ChatGPT's crawlers rarely request the file, and OpenAI has not committed to using it as a signal.

Does Perplexity use llms.txt?

Logs show PerplexityBot requesting the file at negligible rates. There's no confirmation it influences which sources Perplexity cites.

Does Gemini use llms.txt?

No. Google, which builds Gemini, has stated it does not support llms.txt.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers which parts of your site they may access. llms.txt is meant to point AI tools to your best content. It can't block anything, and unlike robots.txt, it isn't widely honoured.

Can llms.txt hurt my website?

It can, if it's set up the wrong way. Creating indexable duplicate copies of your pages can confuse Google and weaken your original pages' rankings.

What should I focus on instead?

Clear, helpful, well-structured content and a trustworthy, fast website. That's what makes both Google and AI search systems treat your business as worth recommending.

The bottom line

llms.txt is a hedge, not a growth channel. The honest position: it costs little, it might help machines read your site one day, but right now it changes almost nothing about whether customers find you.

Your visibility in 2026 is won the same way it always was: by being the clearest, most trustworthy answer to the question your customer is asking. That's true for Google, and it's true for every AI search tool learning to recommend businesses.

Spend your time there.

Sources

Google Search Central statements on llms.txt (John Mueller and Gary Illyes, 2025)
OtterlyAI, llms.txt crawler analysis — https://otterly.ai/blog/the-llms-txt-experiment/
Limy, AI crawler research on llms.txt — https://limy.ai/blog/llms.txt-in-2026-the-full-guide

About the author

Barry Roodnat is Co-Founder of WE-Optimizz, which he started together with Bruno Dini. Barry specialises in SEO and Generative Engine Optimization (GEO), helping businesses improve their visibility across Google, ChatGPT, Gemini and Perplexity. He regularly researches how AI search engines such as ChatGPT, Gemini and Perplexity discover, cite and recommend businesses.

Wondering whether your website is ready for Google, ChatGPT, Gemini and Perplexity? At WE-Optimizz we audit both traditional SEO and Generative Engine Optimization (GEO) to identify what's helping, or preventing, your business from being recommended by AI search tools. Request your free AI Visibility Audit and discover where your biggest opportunities lie.