Llms.txt

is an emerging web standard designed to help website owners control how their content is accessed and used by large language models (LLMs) like ChatGPT or Claude. Inspired by robots.txt, this file specifies whether AI crawlers can scrape your content—and under what conditions.

As AI agents increasingly reference website content in answers, llms.txt helps protect IP, manage attribution, and signal AI-readiness to future search systems.

We break it all down in our step-by-step guide, SEO for ChatGPT: Help LLMs Understand Your Website.