No. As of November 2026, llms.txt does not improve your visibility in AI search. Google has said on the record that its Search systems ignore the file. No major AI provider has confirmed its production answer systems read it. Studies covering hundreds of thousands of domains found no link between publishing llms.txt and getting cited by AI tools.
The file is not worthless. It is just the wrong tool for the job most people hire it to do. Here is who actually benefits, and where your budget should go instead.
What Is llms.txt?
llms.txt is a plain Markdown file placed at the root of your domain, at yoursite.com/llms.txt. It lists your most important pages with a one-line description of each, so a language model sees a curated map of your site instead of parsing every page.
AI researcher Jeremy Howard proposed it in September 2024. It remains a proposal, not a ratified standard, so nobody enforces it and no validator checks it. A typical file groups links under headings:
Heading: Services
/seo.md - What the service covers, pricing tiers, and turnaround.
Heading: Policies
/refunds.md - Refund eligibility and processing timelines.
That is the whole specification. Anyone can ship one in under an hour.
Who Is llms.txt Actually For?
llms.txt serves a narrow group of sites, and that group probably does not include yours.
It genuinely helps:
Software documentation sites, where coding agents pull docs into a limited context window
API and developer-tool companies whose buyers ask AI assistants technical questions
Large JavaScript-heavy sites, where a Markdown mirror saves an agent real parsing effort
It does close to nothing for:
Local service businesses, clinics, law firms, and contractors
Ecommerce stores and marketplace sellers
Blogs, publishers, and standard marketing websites
Anthropic and OpenAI both publish llms.txt files for their developer docs. Neither expects a ranking lift. They publish so agents handle their documentation accurately.
If you land in the second list, add the file only when it takes under an hour, then move on. It costs little and carries low risk, with one caveat: it hands competitors a tidy map of your best pages. Treat it as a cheap hedge, never as a growth tactic.
How llms.txt Works, and Why That Design Fails for AI Search
llms.txt works at inference time. The theory says an AI tool fetches the file while answering a question, reads your list, and pulls the right page. Three things break that chain.
Almost nothing requests the file. Ahrefs studied 137,000 domains and found 97% of published llms.txt files received zero requests in May 2026. Not from GPTBot, not from ClaudeBot, not from Googlebot.
The file is self-declared. You tell a machine what your site is about, with no way for it to verify the claim. Google's John Mueller compared this to the old keywords meta tag, which died for that exact reason. If a model can read your pages, why trust your summary of them?
AI answers run through existing search indexes. ChatGPT's web results lean on Bing, and Gemini runs on Google's index. Both were built on crawling, ranking, and link signals. A file at your root never enters that pipeline, so if your page does not surface in the search layer underneath, llms.txt cannot rescue it.
Does llms.txt Improve AI Citations or Google Rankings?
No, and this has been tested at scale.
What Google Says
Google's May 2026 AI optimization guide includes a mythbusting section stating that site owners do not need special machine-readable files to appear in generative AI features. On June 15, 2026, Google logged a changelog entry titled "Clarifying guidance on llms.txt files" confirming the file neither helps nor harms Google Search visibility, because Search ignores it. Gary Illyes said the same at Search Central Live in July 2025.
What Independent Studies Found
SE Ranking analysed roughly 300,000 domains and found no correlation between llms.txt and AI citation frequency. When they removed llms.txt from their predictive model, the model got more accurate, meaning the file added noise rather than signal. A separate six-month agency test tracking ChatGPT, Gemini, AI Overviews, and AI Mode saw visibility scores stay flat.
Why Chrome Audits for llms.txt When Google Search Ignores It
Days after Google Search told site owners to skip llms.txt, the Chrome team shipped an llms.txt check inside Lighthouse's experimental agentic browsing audits. Two teams, two problems. Search cares about ranking and retrieval. Chrome cares about browser agents completing tasks on your site efficiently.
The check is optional, and a missing file returns "n/a" rather than a penalty. Seeing it flagged in an audit tool proves nothing about AI search.
What Actually Gets Your Brand Cited in AI Answers
These levers carry the weight that llms.txt does not.
Earn mentions on sources models already trust. Ahrefs measured 75,000 brands and found branded web mentions correlate with AI Overview visibility at 0.664, against 0.218 for backlinks. Being talked about beats being linked to.
Rank in the top 10 for your core queries. Most AI Overview citations come from pages already on page one, so technical SEO decides whether your page is even eligible.
Fix crawling and indexing first. A page that never gets indexed cannot be cited. Start with why Google crawls pages without indexing them.
Answer questions directly on the page. Lead with the answer and keep sections self-contained. Extractable content gets quoted.
Publish genuine expertise. Google's guidance points toward first-hand experience, covered in why original experience matters in AI search.
Show up beyond Google. AI assistants cite Reddit, YouTube, directories, and review sites, as our guide on where customers search beyond Google explains.
How to Measure Whether llms.txt Did Anything
Do not guess. Check three things:
Server logs. Filter requests for /llms.txt by user agent. If GPTBot and ClaudeBot never ask for it, nothing downstream matters.
Referral traffic. Watch GA4 for sessions from chatgpt.com, perplexity.ai, and claude.ai.
Prompt testing. Ask ChatGPT, Gemini, and Perplexity ten questions your site should own, then record which domains get cited and repeat monthly.
Our walkthrough on measuring AI search visibility covers the full setup.
Frequently Asked Questions
Is llms.txt a Google ranking factor?
No. Google confirmed Search ignores llms.txt, so it neither helps nor hurts rankings, AI Overviews, or AI Mode visibility.
Do ChatGPT, Claude, and Perplexity read my llms.txt file?
No provider has publicly confirmed it. Some crawlers have been seen fetching the file, but fetching is not the same as using it to decide citations.
What is the difference between llms.txt and robots.txt?
robots.txt controls crawler access and every major crawler respects it. llms.txt suggests which content matters and almost no crawler requests it. It also blocks nothing, so manage AI crawler access through robots.txt.
Should I remove an llms.txt file I already have?
No. It causes no harm. Keep the links current, since a file pointing at dead pages is worse than none.
Does llms-full.txt work better than llms.txt?
Not for visibility. It holds full page text rather than links and faces the same adoption problem. It suits documentation-heavy sites feeding manuals to coding tools.
Why do SEO tools flag a missing llms.txt file?
Audit tools added the check because the topic trended, not because any platform confirmed it as a signal. A 404 on /llms.txt is not worth prioritising.
Get an Honest Read on Your AI Visibility
Most llms.txt advice sells certainty the data does not support. We would rather show you where your brand stands in AI answers and fix what moves the needle.
Our generative engine optimization services cover prompt-level visibility audits, citation tracking, and the content work that earns mentions. Pair that with content writing built for extraction and you have a strategy that holds up whether or not llms.txt is ever adopted.
Request a free AI visibility audit to see which questions your brand already wins and which ones it is missing.
