With AI tools like ChatGPT and Claude shaping how users discover and consume information online, website owners now have a unique opportunity to guide how their content is interpreted, using a simple file called llms.txt.
This guide walks you through how to create a well-structured llms.txt file and host it correctly at the root of your website, plus answers to common questions at the end.
What Is llms.txt?
llms.txt is a proposed open standard that lets you provide AI models with a curated map of your website’s most important and reliable resources.
Think of it as a signpost for AI systems, highlighting documentation, product information, policies, or anything you want them to understand and prioritize accurately.
Step-by-Step Guide: How to Generate an llms.txt File
Step 1: Create the File
You can build the file two ways:
- Manual Method:
Open a text editor (Notepad, TextEdit, VS Code) and create a new file namedllms.txt. - Automated Method:
Use a tool like:
These tools can help pull links and generate a file automatically based on your site’s structure.
Step 2: Format the Content Using Markdown
Use simple Markdown to organize your content clearly. Include:
- A top-level
#header with your brand name - A
>blockquote summarizing what your site does ##headers for main categories like Documentation, Services, Policies, etc.- Bullet points listing URLs with short, helpful descriptions
Example:
# TrailPeak Gear
> TrailPeak designs high-performance hiking and backpacking gear for outdoor explorers worldwide.
## Product Resources
- [Gear Finder](https://trailpeak.com/tools/gear-finder): Interactive tool to match hikers with recommended gear.
- [Backpack Comparison Chart](https://trailpeak.com/products/compare): Detailed feature breakdown across our backpack models.
## User Guides
- [Tent Setup Instructions](https://trailpeak.com/guides/tent-setup): Step-by-step setup videos and manuals.
- [Sleeping Bag Care Guide](https://trailpeak.com/guides/sleeping-bag-care): Tips to extend the life of your sleeping bag.
## Company Policies
- [Warranty Information](https://trailpeak.com/policies/warranty): Details on our lifetime gear warranty.
- [Return Policy](https://trailpeak.com/policies/returns): Process and eligibility for product returns.
## Optional
- [Field Notes Blog](https://trailpeak.com/blog): Outdoor advice, survival tips, and gear reviews.
- [Ambassador Program](https://trailpeak.com/community/ambassadors): Join our explorer community.
Step 3: Save the File
Ensure the file is saved with the name llms.txt, not .docx, .md, or .html. Use plain text encoding (UTF-8).
Step 4: Host the File at the Root of Your Website
The file must be accessible at:https://yourdomain.com/llms.txt
Hosting Options:
For WordPress and CMS Sites:
- Use your hosting control panel (like cPanel or Plesk) or an FTP client (e.g., FileZilla).
- Navigate to the root folder of your website, where your
robots.txtorindex.phpfiles live. - Upload
llms.txtinto this folder.
For Static Site Generators (Netlify, Vercel, GitHub Pages):
- Place
llms.txtin yourpublic/or root project folder. - Redeploy your site so it appears at the root domain.
Verify Installation:
Open your browser and go to https://yourdomain.com/llms.txt. You should see your content in plain text.
Step 5: Maintain the File Regularly
As your site evolves, keep the llms.txt file up to date:
- Add new links when launching new features or products
- Remove outdated or broken content
- Review the file every few months to ensure accuracy
FAQ: llms.txt Best Practices
No, creating and hosting an llms.txt file is simple enough for most non-technical users, especially if you use a generator.
While sitemap.xml helps search engines index content and robots.txt manages crawler access, llms.txt is for LLMs and AI systems to better understand and represent your content.
Focus on high-quality, evergreen pages: documentation, product specs, pricing, tutorials, policies, and authoritative content.
Only if those pages are publicly accessible. AI systems can’t access login-gated or private URLs.
Not yet, but early adopters are laying the groundwork. Some platforms (like Mintlify) are already using it to enhance AI responses.
Final Thoughts
The llms.txt file is a small but powerful tool for future-proofing your website. It lets you play an active role in how AI models interpret and surface your content, reducing misrepresentation and increasing content visibility in AI-powered tools.
Start building your own today using a text editor or generator, and make your site’s most valuable content AI-ready in minutes.
