Is llms.txt Worth It? What Google Says, and What We Recommend
Part of our AI search guide.

llms.txt is a proposed text file that gives AI agents a summary of your site and links to key pages. Google says it isn’t needed for Search and won’t help or hurt rankings, and it lists llms.txt among the AEO and GEO hacks you can ignore. It’s cheap to add for documentation-heavy sites, but it shouldn’t be part of anyone’s AI search plan.
What is llms.txt?
llms.txt is a plain text file in Markdown, placed at yoursite.com/llms.txt. It gives AI tools a short description of your site and a list of links to its most useful pages.
It was proposed by Jeremy Howard in September 2024 as a way “to help agents use a website” (llmstxt.org). The idea is that an AI agent can read one small file instead of crawling the whole site. It’s a proposal, not an agreed web standard like robots.txt.
What does Google say about llms.txt?
Google has been unusually direct. Its guide to generative AI features in Search says you can ignore tactics like “chunking” content, “creating unnecessary AI text files (like llms.txt)”, or pursuing inauthentic mentions (Google Search Central).
In June 2026 Google also added a note that llms.txt files aren’t needed for Google Search and won’t affect visibility or rankings either way. It added that keeping one is fine if other services use it.
So for AI Overviews, AI Mode and normal Google rankings, llms.txt does nothing.
Does it help with ChatGPT or Perplexity?
We haven’t found any public statement from OpenAI or Perplexity saying their search products use llms.txt to choose or cite sources. Both say their search crawlers follow robots.txt, and both cite pages they find through web search.
Some developer tools and AI coding assistants do read llms.txt, mainly to find documentation. That’s a real use, but it’s a different job from getting your business recommended.
Get your free SEO & AI visibility audit report ↓
Should you add one?
| Your site | Our recommendation |
|---|---|
| Software, API or product documentation | Worth adding. Developer tools may read it, and it takes an hour. |
| Service business, shop or agency site | Optional. It won’t hurt, but don’t expect it to change rankings or AI answers. |
| Any site paying an agency for “AI optimisation” | Don’t pay for it as a deliverable. Ask what else is in the plan. |
In our own AEO and GEO work we treat llms.txt as optional. We see it as a red flag when it’s the centre of an agency’s offer.
What should you do instead?
- Let the right crawlers in. Check robots.txt and your firewall for Googlebot, OAI-SearchBot and PerplexityBot. A blocked crawler matters far more than a missing llms.txt.
- Answer buyers’ questions on your own pages, with prices, a clear service description and an FAQ.
- Keep your business facts consistent across your site, Google Business Profile and directories.
- Earn genuine mentions on the lists, reviews and articles AI engines read. See our guide to brand mentions vs backlinks.
- Measure it. Use Search Console’s Generative AI report for Google, and check your key questions in ChatGPT and Perplexity each month.
If you want one anyway, how do you make it?
Create a Markdown file at the root of your site. Start with an H1 with your business name, then a one-line summary, then sections with links to your key pages: services, prices, about and contact. Keep it short and accurate.
Some WordPress SEO plugins can generate one for you. Check what it lists, because an auto-generated file can include pages you’d rather not point to.
Want to know where your brand stands in AI search?
We run your top buyer questions through ChatGPT, Perplexity, Gemini and Google AI Overviews, show you who gets named today, and give you the first three fixes. It’s a free 30-minute session.
Book a free AI visibility audit · See our AEO & GEO services
Get your free SEO & AI visibility audit
We check how your site ranks on Google and whether ChatGPT, Perplexity, Gemini and Google AI Overviews mention you, then send you a short report with your first three fixes.
FAQ
Does llms.txt help SEO?
No, not for Google. Google says llms.txt files aren’t needed for Google Search and won’t affect your visibility or rankings.
Does ChatGPT use llms.txt?
We haven’t found any public statement from OpenAI that ChatGPT search uses llms.txt to choose or cite sources. It finds pages through web search and its crawlers follow robots.txt.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may access, and search engines follow it. llms.txt is an optional summary file for AI agents, and nothing requires any service to read it.
Can llms.txt hurt my site?
Not in Google, which says it has no effect either way. The only risk is the time or money spent on it instead of work that matters.
Who invented llms.txt?
Jeremy Howard proposed it in September 2024, as a standard way to give AI agents a summary of a website. It remains a proposal rather than an agreed standard.
