What is an llms.txt file?
Quick answer
AI assistants increasingly read websites on a person's behalf — to answer a question, to explain a tool, to act inside a workflow. An llms.txt file is a website's way of introducing itself clearly to those assistants instead of leaving them to infer everything from raw pages.
What is an llms.txt file?
It is a single plain-text file, placed at a predictable path like /llms.txt, that summarizes a website in language a model can absorb quickly. It is short, structured, and written to be read in one pass. The idea borrows the spirit of robots.txt — a small file at a known location — but its job is explanation rather than crawl rules.
What goes in an llms.txt file?
- A short description of what the site is and who it is for
- The key URLs, each with a one-line summary
- Any rules or formats someone needs to know to use the site
- A pointer to a longer document for assistants that want more detail
How is it different from robots.txt?
robots.txt tells crawlers which paths they may and may not visit. It controls access. llms.txt does not control anything — it explains. One is a gate; the other is a guide. A site can, and often does, have both, and they do not overlap in purpose.
Why would a website add one?
When an AI assistant understands a site accurately, it describes that site accurately to the person asking. A clear llms.txt reduces the chance of a wrong summary and makes it more likely the assistant points someone to the right page. For a site whose whole purpose is to be used mid-task, that accuracy is worth a short file.
How does ArcadeLab use llms.txt?
ArcadeLab serves a file at arcadelab.ai/llms.txt that explains the platform, lists the key pages, and describes the publishing format, plus a longer companion document for assistants that want the full briefing. It is part of treating AI assistants as a real audience — the same thinking behind building an AI-friendly website.
Curious what a publishing platform looks like? See arcadelab.ai/publish.
Ready to publish? Paste your HTML file and get a URL.
🚀Publish your thing