llms.txt
llms.txt is a proposed plain-text file you place at the root of your site to give AI models a clean, curated map of your most important content, written in a format that is easy for them to read. Think of it as a robots.txt designed for the era of large language models.
You already know robots.txt, the little file that tells crawlers where they can and cannot go. llms.txt is a newer, separate idea aimed at AI models. It is a proposed standard, a plain-text file you put at your site root, that hands large language models a clean, curated guide to your most important content in a format built for them to parse easily.
The motivation is straightforward. A model trying to understand your site has to wade through navigation, ads, scripts, and clutter to find the substance. llms.txt cuts through that. It points to your key pages and can include concise summaries written in clean Markdown, so the model gets the signal without the noise. It is an emerging convention, not a rule any engine is required to honor yet, but it is gaining attention as AI traffic grows.
What goes in an llms.txt file
- A short description of what your site or business is, in plain language.
- Links to your most important pages, grouped logically, often as a clean Markdown list.
- Brief summaries of those key pages so a model grasps each one quickly.
- Optionally, links to expanded plain-text or Markdown versions of important documents.
llms.txt is a curated map you hand the model. You decide what matters, instead of leaving it to dig through your clutter.
Should you actually add one
Be honest about where this stands. As of now, llms.txt is a proposed convention, and the major AI engines have not committed to reading it the way they read robots.txt. So treat it as low-cost insurance, not a magic switch. It is cheap to create, it does no harm, and if adoption grows you are already positioned. But do not expect it to single-handedly change your citation numbers today. The fundamentals of clear, structured, authoritative content matter far more right now.
targetHonest expectations
I will not oversell this one. llms.txt is promising and worth doing because it is nearly free, but it is unproven and not yet widely honored by the engines. Add it as a sensible bet on where things are heading, then put your real effort into the content and structure that engines reward today.
Example
A SaaS company adds an llms.txt at its root with a one-line description, then a Markdown list linking to its pricing page, its product overview, its documentation, and its main guides, each with a one-sentence summary. If an AI engine chooses to read the file, it gets a clean, accurate snapshot of what the company offers and where the authoritative pages live, instead of guessing from a cluttered homepage.
lightbulbPRO TIP
If you add an llms.txt, keep it short and current. List only your genuinely important pages with crisp summaries, and update it when your key content changes. A stale or bloated file is worse than none, because it can point a model at the wrong things.
Cheap bet, not a silver bullet
Add llms.txt as low-cost insurance on an emerging standard, but keep your real GEO effort on clear, structured, authoritative content that engines already reward.
llms.txt is a small piece of a much bigger GEO picture. For where to actually spend your energy, start with my guide on what GEO is and how to do it.
RELATED TERMS
Want this handled by someone who has measured search for 20 years?
Work with me