AI & Search

llms.txt

A proposed plain-text file that gives AI tools a curated guide to your site's most important content.

llms.txt is an emerging convention - a file at the root of your site (like robots.txt) that points AI systems to your most useful, structured content in a clean, easy-to-read form. The idea is to help AI tools understand your site without wading through navigation, ads, and scripts.

Adoption is still early and support varies, but adding one is low-effort and forward-looking. It sits alongside the more fundamental question of whether AI crawlers are even allowed to read your pages in the first place.

Further reading

Related terms

Want to see how your page measures up on this and more?

Free first audit

Ready to see what's holding your site back?

Run one page through AuditCrow and get a clear, prioritised report on what is standing between your site and the job you need it to do.

One page free · Plain-language fixes · Your first taste of the full platform