What Is LLMS.txt And What It Is Not
llms.txt is a plain-text Markdown file that you place at the root of your website, accessible at yourdomain.com/llms.txt. Its purpose is to help AI language models like ChatGPT, Claude, Perplexity, and Gemini quickly understand what your website is about and where your most important content lives.
It was proposed in September 2024 by Jeremy Howard, co-founder of Answer.AI, and has since been adopted by major companies, including Anthropic, Cloudflare, Stripe, and Vercel. As of 2026, it has become a foundational element of Agentic SEO (AEO).
Here is the key thing to understand: llms.txt is not a blocking or permission file. It does not block AI bots from crawling your site. It does not use Disallow: or Allow: rules. That is what robots.txt is for.
Think of llms.txt as a curated reading list for AI. It points AI systems directly to your best pages, your guides, documentation, product information, and FAQs so they can understand your brand accurately, without having to parse through navigation menus, cookie banners, JavaScript, and marketing copy to find the useful content.
A simple way to think about the difference between the main web files:
- robots.txt tells search engine crawlers what they can and cannot access.
- sitemap.xml lists every page on your website for indexing.
- llms.txt is a hand-picked, AI-friendly summary pointing to your most valuable content.
- agents.md (New in 2026) provides specific instructions for AI agents on how to interact with and transact on your site.
- llms-full.txt contains the full text of your site’s core content in a single file for deep context.
How LLMS.txt Differs from robots.txt
This is where a lot of guides get it wrong.
robots.txt uses a specific syntax:
User-agent: GPTBot
Disallow: /checkout/
Allow: /blog/
llms.txt uses Markdown, not this syntax at all. It is a human-readable document structured with headings and links, not a list of crawling rules.
If you want to block AI bots from crawling certain parts of your website, you should do that in your robots.txt file using the appropriate bot names (e.g., GPTBot for OpenAI, ClaudeBot for Anthropic). The llms.txt file serves a completely different purpose.
Why Should eCommerce Businesses Care?
AI tools are increasingly how people discover products and businesses. When someone asks ChatGPT, “What are the best Shopify development agencies in the UK?” or asks Perplexity to “find me a Magento developer,” those tools pull information from the web in real time. Without clear, structured information to reference, AI systems often guess, and they guess wrong.
An llms.txt file gives you direct input over how AI tools understand your business. Some practical reasons to implement it:
Better accuracy in AI-generated answers.
When AI tools have a clean, structured file pointing to your services, products, and key pages, they are far less likely to serve outdated or incorrect information about your brand.
Faster context for AI agents.
Modern websites are full of clutter that makes them hard for AI systems to parse quickly. A Markdown file with links to your most important content removes that friction entirely.
A low-effort, forward-looking investment.
The file takes minutes to create. As AI-driven discovery continues to grow as a traffic source, having this in place early puts you ahead.
The Correct LLMS.txt Format (With Examples)
The llms.txt file must be written in Markdown. The structure follows this pattern:
# Your Site or Brand Name
> A short description of what your website or business does.
Optional additional context about your business or content.
## Section Name (e.g. Services, Blog, Documentation)
– [Page Title](https://yourdomain.com/page ): A short description of what this page covers.
– [Another Page](https://yourdomain.com/another-page ): What this page is about.
## Optional
– [Less critical page](https://yourdomain.com/optional-page ): AI can skip this if context is limited.
Required element: The H1 heading (# Your Site Name) is the only required element.
The “Optional” section has a special meaning in the specification: links placed under a heading named ## Optional can be skipped by AI systems if they are working with limited context windows.
Here is a real-world example for an eCommerce agency:
# Kiwi Commerce
> Kiwi Commerce is a full-service eCommerce agency based in the UK,
> Specialising in Magento, Shopify, Hyva, and WordPress development
> for ambitious brands.
We help online retailers build, optimise, and scale high-performance
stores. Our team covers development, UX design, migration, and
digital marketing.
## Services
– [Magento Development](https://kiwicommerce.co.uk/magento-development/ ): Custom Magento builds, upgrades, and integrations.
– [Shopify Development](https://kiwicommerce.co.uk/shopify-development/ ): Shopify store builds, app integrations, and theme work.
– [Hyva Theme Development](https://kiwicommerce.co.uk/hyva-themes-development/ ): Hyva frontend builds for Magento stores.
– [Replatforming & Migration](https://kiwicommerce.co.uk/services/replatforming-and-migration/ ): Moving between platforms with minimal disruption.
## Blog & Guides
– [Blog](https://kiwicommerce.co.uk/blog/ ): Practical guides on eCommerce development, SEO, and platform tips.
## Optional
– [Case Studies](https://kiwicommerce.co.uk/casestudies/ ): Examples of work completed for clients.
– [About Us](https://kiwicommerce.co.uk/about-us/ ): Background on the Kiwi Commerce team.
Notice: no User-agent, Disallow, or Allow rules anywhere. Those belong in robots.txt.
Where to Place the llms.txt File for the Website
A common question is: “llms.txt go on site root or where?” The answer is simple: it must go in the root directory of your website. This means it should be accessible directly after your domain name, like this: https://yourdomain.com/llms.txt.
If you place it in a subfolder (e.g., https://yourdomain.com/assets/llms.txt ), AI agents will not find it automatically.
How to Add LLMS.txt to Shopify (2026 Update)
CRITICAL UPDATE: If you are reading older guides (from 2024 or 2025), they will tell you to upload the file to Shopify’s CDN and create a URL redirect. Do not do this anymore.
As of May 2026, Shopify natively supports llms.txt, agents.md, and llms-full.txt. Shopify automatically generates these files for all stores to support its Agentic Commerce Protocol. However, the default files often push users toward Shopify’s own Shop app rather than keeping them on your store.
To take control of your AI narrative, you must override these default files using Liquid templates.
Step 1: Create Liquid Templates in Your Theme
- In your Shopify admin, go to Online Store → Themes.
- Click the three dots (…) next to your active theme and select Edit code.
- Under the Templates folder, click Add a new template.
- Select liquid as the template type.
- Name the file exactly llms.txt.liquid.
- Repeat this process to create agents.md.liquid and llms-full.txt.liquid if you want to customize those as well.
Step 2: Add Your Markdown Content
Open your newly created llms.txt.liquid file and paste your Markdown content.
Important Note for agents.md: If you are overriding agents.md.liquid, be careful not to remove the Universal Commerce Protocol (UCP) discovery links (like /.well-known/ucp) that Shopify includes by default, as these are necessary for AI agents to actually complete transactions on your store.
Step 3: Verify
Visit https://yourdomain.com/llms.txt in your browser. You should see your custom Markdown content load correctly, overriding the Shopify default.
Kiwi Commerce tip: If you need help with the Shopify setup or want to take things further with a full Shopify build or optimisation, our Shopify development team is happy to assist.
How to Add LLMS.txt to WordPress
Option 1: Manual (via FTP or File Manager)
- Create a new plain text file on your computer and name it llms.txt.
- Write your content in Markdown format (see the example above).
- Connect to your server via FTP (using a client like FileZilla) or use your hosting panel’s File Manager.
- Upload the file to your site’s root directory—the same folder where wp-config.php lives, typically /public_html/.
- Verify it is live by visiting https://yourdomain.com/llms.txt in your browser.
Option 2: Free Plugin
If you would rather not work with files directly, the “Website LLMs.txt” plugin (available free on WordPress.org ) handles file generation and management from within your WordPress dashboard. It lets you choose which post types and pages to include, and it generates a properly formatted Markdown file automatically.
Another solid free option is the “LLMs.txt and LLMs-Full.txt Generator” plugin, which generates both the summary llms.txt and a comprehensive llms-full.txt in one go.
Kiwi Commerce tip: If you already use Yoast SEO, it has a basic llms.txt feature built in, though it generates a fairly minimal file. The dedicated plugins above give you more control over what is included.
How to Add LLMS.txt to Magento
- Connect to your server via FTP or SSH.
- Navigate to your Magento root directory—the folder containing index.php, app/, and pub/.
- Create a new file named llms.txt in that root directory.
- Write your Markdown content listing your key category pages, product ranges, support pages, and guides.
- Upload and verify it is accessible at https://yourdomain.com/llms.txt.
Example for a Magento store:
# Your Store Name
> We sell (product category ) online. Based in [location], we ship across the UK and Europe.
## Products
– [Full Product Catalogue](https://yourdomain.com/catalog/ ): Browse all product categories.
– [New Arrivals](https://yourdomain.com/new/ ): Recently added products.
## Customer Information
– [Shipping Policy](https://yourdomain.com/shipping ): Delivery times and costs.
– [Returns Policy](https://yourdomain.com/returns ): How to return an order.
– [FAQ](https://yourdomain.com/faq ): Common questions answered.
## Optional
– [About Us](https://yourdomain.com/about-us ): Our story and values.
Kiwi Commerce tip: Make sure your Magento server configuration serves .txt files correctly. Most setups do by default, but if the file returns a 404, check your .htaccess or Nginx config.
How to Add LLMS.txt to Custom-Built Websites
For sites built with PHP, Node.js, React, or any other stack:
- Create your llms.txt Markdown file.
- Place it in your web root—the directory from which your server serves files publicly (e.g., /var/www/html/, /public/, /dist/).
- Deploy to your live server and verify at https://yourdomain.com/llms.txt.
For static sites, simply add the file to your build output folder before deploying.
LLMS.txt Best Practices
To maximize the effectiveness of your llms.txt and agents.md files, consider these best practices:
- Quality over Quantity: Focus on linking to your most valuable, high-quality content. Avoid including low-value or duplicate pages. A concise, well-curated llms.txt is more effective than an exhaustive one .
- Regular Updates: As your website content evolves, ensure your llms.txt and agents.md files are updated to reflect these changes. Outdated information can lead to AI models providing incorrect answers about your business.
- Clear and Concise Descriptions: For each linked page, provide a brief, accurate description of its content. This helps AI models quickly understand the purpose and relevance of the page.
- Utilize ## Optional Section: For less critical but still relevant content, use the ## Optional heading. This signals to AI systems with limited context windows that these pages can be skipped if necessary, ensuring focus on your core offerings.
- Differentiate llms.txt and agents.md (for Shopify ): While Shopify defaults to serving the same content for both, it’s recommended to customize llms.txt for descriptive summaries and agents.md for specific agent instructions, especially those related to transactions and APIs .
- Monitor and Verify: Regularly check that your llms.txt and agents.md files are accessible at their root paths and that the content is correctly formatted. Use tools or manual checks to ensure AI models can read them as intended.
Does LLMS.txt Help SEO?
The relationship between llms.txt and traditional SEO (Search Engine Optimization) is a nuanced one. While llms.txt is crucial for AEO (Agentic Search Engine Optimization) and AI discovery, its direct impact on Google’s traditional search rankings is currently limited.
- Not a Direct Ranking Factor (for Google Search): Google has stated that llms.txt is not a direct ranking signal for its web search algorithm . This means implementing llms.txt alone will not directly improve your position in Google’s organic search results.
- Indirect SEO Benefits: However, llms.txt can offer indirect SEO benefits. By providing clear, structured information to AI models, you enhance the accuracy of AI-generated answers about your brand. As AI-powered search and discovery become more prevalent, being accurately represented by AI can drive brand awareness, direct traffic, and ultimately influence purchasing decisions, which can indirectly benefit your overall online presence and traditional SEO efforts.
- Crucial for AI-Powered Discovery: The primary benefit of llms.txt (and agents.md) lies in optimizing for AI-powered search engines and conversational AI interfaces. As users increasingly rely on AI assistants for information and product discovery, having these files ensures your content is understood and presented correctly in these new environments .
Final Thoughts
The digital landscape is rapidly evolving with the rise of AI. While traditional SEO remains vital, optimizing for AI-powered discovery through llms.txt and agents.md is becoming an indispensable strategy for eCommerce businesses. By taking control of how AI models perceive and interact with your website, you can ensure your brand remains visible, accurate, and competitive in the age of agentic commerce. Proactive implementation and regular updates of these files will position your business at the forefront of AI-driven customer engagement.
Kiwi Commerce 
