What the llms.txt generator does
This tool creates an llms.txt file for your website: a plain-text, Markdown-formatted map that tells AI models and agents what your site is about and which pages matter most. You enter your URL, Etoolio fetches your homepage and key internal pages, writes a short description for each, and hands you two ready-to-download files, llms.txt (a concise index) and llms-full.txt (the same index plus the readable content of each page).
Why llms.txt matters in the AI-search era
Search is shifting from ten blue links to AI answers. Tools like ChatGPT, Claude, Perplexity and Google's AI Overviews read the web to answer questions directly, and they need to understand your site quickly and correctly. An llms.txt file is the emerging convention for that, the large-language-model equivalent of robots.txt or a sitemap. It gives AI systems a clean, curated summary instead of forcing them to guess from cluttered HTML, which improves how accurately they describe and cite you.
How to use it
- Enter your website URL (for example
example.com) and press Generate. - Wait a few seconds while Etoolio crawls your homepage and key pages and summarises each one.
- Review the two files. Switch between the
llms.txtindex and the fullerllms-full.txtexport using the tabs. - Copy or download the file you want.
- Upload it to your site's root so it is served at
https://yourdomain.com/llms.txt.
llms.txt vs llms-full.txt
- llms.txt is a short index: your site name, a one-line summary, and a bulleted list of key pages, each with a link and a brief description. Keep this lean, it is meant to be scannable.
- llms-full.txt is a larger export that also embeds the readable text of each page, so an AI model can ingest your actual content in one file. Use it when you want models to have the substance, not just the map.
Best practices
- Put your most important pages first, your homepage, core product or service pages, documentation and key guides.
- Keep descriptions factual and concise. One clear sentence per page beats marketing fluff, AI models quote what is unambiguous.
- Update it when your site changes, just as you would a sitemap, so the summary stays accurate.
- Pair it with crawler access. An llms.txt only helps if AI crawlers are allowed to read your site, check your robots.txt with Etoolio's AI Crawler Access Checker.
Good to know
- The file is generated from the public pages of the URL you enter, nothing is stored afterwards.
- llms.txt is a convention, not a guarantee, not every AI system reads it yet, but adoption is growing quickly and the file does no harm to have.
- This tool is free with no signup, and works for any public website, not just your own.