Documentation / Technical / llms.txt and crawler control

llms.txt and crawler control: complete guide

TL;DR

llms.txt is a text file in the root of your site that summarizes your content for language models. Combined with robots.txt, it allows you to decide what AI bots see and how they understand it.

What is llms.txt

Why it matters for GEO

How to create it step by step

# Your company
> [Brief description of your business]

## Services
- [Service](https://your-site.com/service)

Which AI bots to allow

Common mistakes

Frequently asked questions

Does llms.txt replace robots.txt?

Example answer here.

Where is the file published?

Example answer here.

How often should I update it?

Example answer here.

Related guides

TECHNICAL

Schema and structured data

FUNDAMENTALS

How LLMs choose sources

MEASUREMENT

AI visibility measurement

Prefer us to do it for you?

Our team of GEO/AEO/SEO experts applies everything explained in these guides to your site, and measures the results with the Merissel platform.