What Is llms.txt? Does Your Website Need One for AI Search?
If you’ve been following the changes happening in SEO, you’ve probably heard about something called llms.txt.
It’s a relatively simple text file that website owners can add to their websites to help AI systems understand their content and find important information.
Sounds pretty straightforward, right?
As more people turn to ChatGPT, Gemini, and Perplexity to research products, compare businesses, and find service providers, website owners are understandably looking for ways to make sure their businesses show up in those conversations.
That’s where llms.txt enters the picture.
But there’s a lot of confusion about what this file actually does, whether AI platforms use it, and whether adding one will improve your visibility.
Let’s clear that up.
The short answer: llms.txt is a useful way to organize and summarize important website content for AI systems and other automated tools. However, there is currently no solid evidence that simply publishing one will improve your rankings or guarantee that your business gets mentioned in ChatGPT or other AI search platforms.
And that’s an important distinction.
At Vasilakos Design, we look at AI Search as part of a larger marketing and SEO strategy. Technical files are one piece of the puzzle, but your website content, authority, accessibility, and overall online presence matter much more.
Let’s look at how it works.
What Is an llms.txt File?
An llms.txt file is a plain-text Markdown document placed in the root directory of your website.
For example:
https://yourwebsite.com/llms.txt
The idea was introduced by Jeremy Howard of Answer.AI in September 2024.
Its purpose is to provide AI systems with a simplified overview of your website and links to the information that matters most.
Think about how much information is sitting on a typical business website.
You might have:
- Homepage
- About Us
- Services
- Product pages
- Location pages
- Case studies
- Blog articles
- FAQs
- Contact information
A human visitor can navigate those pages using your website menu.
An AI system may approach that information differently. It has to discover pages, retrieve relevant content, and determine which information helps answer a particular question.
An llms.txt file attempts to make that process easier by giving AI systems a curated list of important resources.
For example, a marketing agency might use its llms.txt file to point to its SEO services, website development services, case studies, company information, and marketing guides.
The goal is simple: make important information easier to discover and understand.
However, there’s an important caveat.
An llms.txt file is a proposed convention, not an officially adopted requirement for AI search engines.
There is no guarantee that ChatGPT, Gemini, or Perplexity will retrieve or use it.
How Is llms.txt Different From robots.txt and sitemap.xml?
This is where things get confusing.
All three files can live in the root directory of your website, but they serve very different purposes.
Here’s the easiest way to understand them.
| File | Purpose |
|---|---|
| robots.txt | Provides crawler access instructions for specific bots and website paths. |
| sitemap.xml | Helps search engines discover URLs on your website. |
| llms.txt | Provides a curated overview of important website information and links for AI systems and other tools. |
1. robots.txt
Your robots.txt file provides instructions to web crawlers about which parts of your website they are allowed or disallowed from accessing.
For example, if you want to manage how certain AI crawlers access your website, you can use robots.txt directives for their documented user-agent names.
Different AI companies operate different crawlers, and they don’t all do the same thing.
Some collect information for model training. Others retrieve content to answer live search questions.
This distinction matters.
Blocking an AI search crawler could prevent your website from being eligible for certain AI search experiences, even if you allow other bots to access your content.
You can learn more through Google’s robots.txt documentation and OpenAI’s crawler documentation.
2. sitemap.xml
Your XML sitemap is essentially a directory of the important URLs on your website.
It helps search engines discover your pages and understand your site’s structure.
If you publish a new service page or blog article, your sitemap helps search engines find that content.
A sitemap is an important part of traditional technical SEO.
3. llms.txt
An llms.txt file is more like a curated reading list.
Instead of listing every URL on your website, you identify the pages that best explain your business and what you offer.
You can also provide short descriptions to help explain what each page contains.
The important thing to remember is that llms.txt does not control crawler access, replace your sitemap, or automatically tell AI systems to recommend your business.
It is an additional resource, not a replacement for the fundamentals.
Does ChatGPT, Gemini, or Perplexity Actually Use llms.txt?
This is probably the most important question.
And the honest answer is that we don’t have evidence that major AI search platforms use llms.txt as a direct ranking or recommendation signal.
In fact, Google’s guidance is quite clear.
Google’s official guide to optimizing for generative AI features specifically states that llms.txt is not required for Google Search or its generative AI features.
Google also explains that publishing one will neither help nor hurt your visibility in Google Search.
There’s another interesting piece of research worth considering.
In June 2026, Ahrefs published a study examining 137,210 domains and their llms.txt traffic.
The findings were surprising:
- 28% of the websites in the study had published an llms.txt file.
- 97% of those files received zero requests during the month studied.
- Only 3% received any requests at all.
- AI retrieval bots accounted for just 1.1% of the recorded requests.
In other words, most published llms.txt files weren’t being accessed.
You can read the full research here: Ahrefs llms.txt Study.
Does that mean llms.txt is pointless?
Not necessarily.
It means we need to stop treating it like some magic SEO switch.
There may be value in providing structured information to AI agents and other automated systems, and adoption could evolve.
But if you’re a business owner trying to get more customers from ChatGPT or Google, there are more important things to work on first.
How to Create an llms.txt File for Your Website
If you want to implement an llms.txt file, the process is relatively simple.
You don’t need an expensive plugin or complicated software.
You need a plain-text file containing Markdown-formatted information about your business and links to your most important website pages.
Here’s an example.
Step 1: Create a Text File
Create a new file named:
llms.txt
Make sure it is a plain-text file and not an HTML document.
Step 2: Add Your Business Information
Start with your company name and a short description of what your business does.
For example:
# Example Marketing Agency
> Example Marketing Agency provides digital marketing,
> SEO, website development, and lead generation services
> to businesses looking to grow their online presence.
We help companies improve visibility, generate leads,
and build marketing strategies focused on measurable results.The description should explain who you are, what you do, and who you serve.
Avoid stuffing the file with keywords or promotional language.
You want to provide useful information, not write an advertisement.
Step 3: Add Your Most Important Website Pages
Next, organize your website links into relevant sections.
For example:
## Services
- [SEO Services](https://example.com/seo/):
Search engine optimization and organic visibility.
- [Website Design](https://example.com/web-design/):
Website development and conversion optimization.
- [Lead Generation](https://example.com/lead-generation/):
Digital campaigns designed to generate qualified leads.
## Company Information
- [About Us](https://example.com/about/):
Company background and experience.
- [Contact](https://example.com/contact/):
Contact information and consultation requests.
## Resources
- [Marketing Blog](https://example.com/blog/):
Marketing insights, SEO advice, and industry updates.This is just an example, but you get the idea.
Choose pages that accurately explain your business and provide useful information.
Step 4: Upload the File to Your Website
Once you’ve created your file, upload it to the root directory of your website.
For a WordPress website, this is generally the main web directory where your robots.txt file and other root-level files are accessible.
Your file should be available at:
https://yourwebsite.com/llms.txt
Visit that URL in your browser to make sure it loads correctly.
You should see the plain-text content rather than a website error or an HTML page.
Step 5: Keep It Updated
Don’t just create the file and forget about it.
If you add new services, change your business information, or remove important pages, update your llms.txt file.
The information should accurately reflect your website.
There’s little value in providing AI systems with outdated information about your business.
What About llms-full.txt?
You may also come across something called llms-full.txt.
It’s a related convention that generally refers to a much larger document containing expanded website information or the content of important pages.
The distinction is relatively simple:
- llms.txt: A concise overview of your business with links to important resources.
- llms-full.txt: A more extensive collection of website information and content.
Neither file is currently a required component of SEO or AI Search optimization.
For most small and medium-sized business websites, I would start with a well-organized llms.txt file if there is a reason to implement one.
I wouldn’t spend hours creating a massive document just because someone says it’s necessary for AI rankings.
Your time and marketing budget are better spent on improvements that have a clearer connection to visibility and lead generation.
What Actually Helps Your Website Show Up in ChatGPT and AI Search?
Now we’re getting to the important part.
If llms.txt isn’t a guaranteed way to improve AI visibility, what should businesses actually be doing?
There’s no single trick that guarantees your business will appear in an AI-generated answer.
AI platforms use different systems, sources, and retrieval processes. Their results can change depending on the question being asked.
But there are several areas where businesses should be investing their time.
1. Make Sure Search Engines and AI Crawlers Can Access Your Website
Start with the technical basics.
Can Google crawl your website?
Are your important pages indexed?
Are you accidentally blocking important AI search crawlers?
Are there broken links, redirect problems, or technical issues preventing your content from being accessed?
Your website needs to be accessible before you can expect it to perform well in search.
Review your robots.txt configuration, XML sitemap, canonical tags, and overall technical SEO.
Don’t assume that because your website looks great in a browser, everything is working properly behind the scenes.
2. Create Content That Actually Answers Questions
This is one of the biggest opportunities for businesses.
Think about the questions your customers ask before making a purchasing decision.
If you’re a commercial lender, those questions might include:
- What is the difference between an SBA 7(a) and SBA 504 loan?
- Can I qualify for commercial financing with limited collateral?
- What are the requirements for a business line of credit?
If you’re a roofing company:
- How much does a roof replacement cost?
- How do I know if I need a new roof?
- Does homeowners insurance cover storm damage?
These are the types of questions people increasingly ask search engines and AI assistants.
Your website should provide clear, helpful answers.
Don’t write content just to fill a blog.
Write content that demonstrates you understand your industry and can actually help potential customers make informed decisions.
3. Build Authority Beyond Your Website
Your website isn’t the only place where your business needs to exist.
Think about the other places people might encounter your brand.
Industry publications.
Business directories.
Professional associations.
Customer reviews.
Industry interviews.
Relevant websites and publications.
When your business is consistently represented across credible sources, you’re building a stronger online presence.
This also helps establish the expertise and reputation that matter in traditional search and AI-assisted discovery.
A website claiming that your company is an industry leader is one thing.
Independent sources discussing your company and its work provide another layer of credibility.
4. Make Your Website Easy to Understand
This sounds obvious, but a surprising number of business websites make it difficult to understand what they actually do.
Your homepage should clearly communicate:
- Who your company is.
- What services or products you offer.
- Who your ideal customers are.
- Where you operate.
- What makes your business different.
- How someone can contact you.
Your service pages should go deeper.
Explain the services, answer common questions, provide relevant examples, and make it easy for visitors to take the next step.
Use descriptive headings, organized content, and appropriate structured data.
You don’t need to write for robots.
You need to make your business easy for people and search systems to understand.
5. Don’t Ignore Traditional SEO
This is where I think a lot of businesses are getting distracted.
AI Search is changing how people find information, but that doesn’t mean traditional SEO suddenly stopped mattering.
Technical SEO, relevant content, search visibility, links, and brand authority remain important parts of a broader online visibility strategy.
Google has also explained that its AI search features use its existing search infrastructure and systems.
So if your website has poor technical SEO, weak content, and very little authority, adding an llms.txt file isn’t going to solve those problems.
Get the fundamentals right first.
6. Monitor Your AI Search Visibility
You can’t improve what you don’t measure.
Start testing how your business appears in ChatGPT, Gemini, and Perplexity.
Ask questions that potential customers might actually use when looking for your services.
For example:
- Who are the best companies for [your service] in [your city]?
- What companies specialize in [your industry]?
- Who provides [specific service] for small businesses?
- What should I look for when hiring a [type of service provider]?
Pay attention to whether your business appears, which competitors are mentioned, and which sources the AI platforms reference.
Repeat the process over time.
AI-generated results aren’t static, so one test isn’t enough to establish whether your business has strong visibility.
At Vasilakos Design, we believe AI Search should be measured as part of an ongoing marketing strategy, not treated as a one-time technical project.
Frequently Asked Questions About llms.txt
Is llms.txt an official SEO requirement?
No. It is a proposed convention introduced by Answer.AI. There is no requirement from Google or other major search engines to publish one.
Does llms.txt improve Google rankings?
No. Google has explicitly stated that llms.txt is not used as a special signal for Google Search or its generative AI features.
Does ChatGPT read llms.txt?
There is currently no published commitment from OpenAI that its production search systems use llms.txt as a ranking or retrieval signal. A crawler requesting a file also doesn’t prove that its contents are used.
Should every business have an llms.txt file?
Not necessarily. It is inexpensive to create, and some automated tools may use it. However, businesses should prioritize technical SEO, helpful content, website accessibility, and brand authority before investing significant time in it.
What is the difference between llms.txt and robots.txt?
Robots.txt provides crawler access instructions. llms.txt provides a curated overview of website information and links. They serve different purposes and are not interchangeable.
Do I need llms-full.txt too?
No. It isn’t a requirement. Most businesses can start with a concise llms.txt file if they decide to implement one.
Can I use llms.txt on a WordPress website?
Yes. You can create a plain-text file and upload it to your website’s root directory. Just make sure it doesn’t conflict with existing server or plugin configurations.
The Bottom Line: Don’t Confuse AI Search Optimization With Adding a File
I think llms.txt is worth understanding, and there is very little downside to creating a properly maintained version of it.
But I wouldn’t make it the centerpiece of your AI Search strategy.
The bigger opportunity is making sure your business is visible, accessible, and recognized as a credible source of information.
That means having a technically sound website, publishing useful content, building authority, maintaining a consistent online presence, and understanding how potential customers are discovering businesses through AI.
We’re moving into a period where getting found online means more than ranking on the first page of Google.
People are asking AI platforms for recommendations, researching companies, comparing services, and looking for answers before they ever visit a website.
Businesses need to adapt.
And that starts with getting the fundamentals right.
At Vasilakos Design, we help businesses improve their online visibility through SEO, AI Search optimization, website development, and lead generation.
We look beyond individual SEO tactics to understand how your website, content, and marketing strategy work together to attract the right customers.
Want to know how your business is showing up in ChatGPT, Gemini, and other AI search platforms?
Contact Vasilakos Design to discuss an AI Search visibility review.
Vasilakos Design | Marketing Strategy. Digital Marketing. Measurable Results.