Has the discussion around LLMs.txt become more noise than signal, and what does it actually mean for AI visibility?
Across the SEO world, platforms and plugins are rushing to include LLMs.txt as if it’s the next frontier of search optimisation. With so much hype, you’d be forgiven for thinking it’s already a must-have for AI search. The reality is different. LLMs.txt remains a proposal that no major AI platform has adopted. So why the scramble? A recent Reddit discussion shines some light on the confusion.
SEO Tools And The LLMs.txt Confusion
Google’s John Mueller recently stepped in on Reddit after a user asked why their SEO tool flagged /llm.txt as missing. The audit seemed to suggest it was required, which left the person wondering whether they needed to create one.
The Redditor wrote:
“Why is SEMRush showing that the /llm.txt is a 404? Yes, I know I don’t have one for the website, but I’ve heard it’s useless and not needed. Is that true?
If I need it, how do I build it?”
SEMrush’s own documentation implies otherwise, warning:
“If your site lacks a clear llms.txt file it risks being misrepresented by AI systems.
…This new check makes it easy to quickly identify any issues that may limit your exposure in AI search results.”
That kind of language gives the impression there’s risk involved when in reality no AI system is using the standard today. No wonder SEOs are left asking, “Do I really need this file?”
Why LLMs.txt Isn’t Necessary
Mueller’s response was blunt:
“Good catch! Especially in SEO, it’s important to catch misleading & bad information early, before you invest time into doing something unnecessary. Question everything.”
His comment cuts to the core: investing time in LLMs.txt today is wasted effort.
Why AI Platforms Haven’t Adopted LLMs.txt
While Google hasn’t issued a formal statement, there are solid reasons AI platforms steer clear. The main one is trust. On-page content is visible to both readers and crawlers, but a separate markdown file could easily be abused.
SEOs have a long history of gaming systems. Hidden text, manipulative schema, or AI prompts can all be slipped into files that bots see but users don’t. That’s exactly why LLMs.txt is viewed as unreliable.
A 2024 research paper, Adversarial Search Engine Optimization for Large Language Models, even demonstrated “Preference Manipulation Attacks” that trick LLMs into recommending content over competitors. The study showed real-world manipulation on Bing, Perplexity, and plugins for GPT-4 and Claude. One striking example: a targeted camera became 2.5 times more likely to be recommended after manipulation.
If there’s a loophole, someone will exploit it. A separate LLMs.txt file practically invites abuse, making it safer for AI platforms to ignore it and stick with standard on-page content.
What SEO Plugins Say About LLMs.txt
Plugins have taken different positions.
Squirrly SEO admits they only added the feature because users demanded it, while making clear it won’t improve AI search visibility:
“LLMs txt will not help you magically appear in AI search. There is currently zero proof that it helps with being promoted by AI search engines.”
Rank Math, by contrast, suggests AI chatbots rely on curated versions of content in these files, claiming it increases the chance of being cited accurately. The problem? That simply isn’t happening. AI chatbots don’t use LLMs.txt, structured data, or side files. They consume the same HTML users see.
Yoast SEO takes a middle road, explaining how it could be used but carefully framing it with terms like “can” and “could.” Their stance is more balanced, but Squirrly’s clarity arguably serves users best: yes, you asked for it, but don’t expect SEO gains.
The Self-Reinforcing Loop Around LLMs.txt
This is where things get messy. Business owners and SEOs, anxious about AI visibility, feel pressured to “do something.” LLMs.txt becomes the quick fix, even though it’s unused. SEO tools and plugins, responding to demand, add support for it. That only fuels the perception it’s necessary, creating a cycle of misunderstanding.
At this stage, LLMs.txt is nothing more than a proposal. No AI platform has adopted it. The belief that it impacts AI search results is a loop of misinformation, not reality.
Final Word
Right now, LLMs.txt is unnecessary. It doesn’t improve AI visibility, isn’t trusted by platforms, and may never become a real standard. While SEO tools and plugins keep pushing it, the best investment remains in clear on-page content, structured information, and trustworthy signals. That’s where AI and users alike are still paying attention.
