llms.txt: what it does and what it does not
5 min read · Updated: 20 Sep 2026
What llms.txt is
llms.txt is a file proposed in 2024 that sits at the site root and lists important pages for language models in Markdown. It is not an official standard.
Unlike robots.txt, the file does not allow or block anything; it only offers a table of contents.
Who uses it
Some developer tools and documentation sites read this file. There is no clear evidence that the major AI engines use llms.txt when producing answers.
This may change. If it does, we will update this guide and the related control.
Why we give it no points
Scoring work whose effect cannot be measured would point your client's budget at something without evidence. That is why llms.txt does not change the readiness score.
The SPM-005 control states this decision and the reasoning openly.
If you still want to add it
The file does no harm. If you add it, keep it short, list only the pages that really matter and write a one-sentence description for each link.
AILens's fix kit includes an optional llms.txt draft; checking that bots can reach your pages and that content is in the first HTML does more.
Check what this article covers on your own site.
Check your site