Looking for the llms.txt WordPress plugin or documentation? Click Here

How to Make Your LLMS.txt Accessible to LLMS (OpenAI, Perplexity, etc)

Strategies for adding your llms.txt file to your website so that it gets indexed quickly (includes WordPress integration options). We are advocating for the option to provide the file directly to OpenAI or Perplexity or to request a crawl in the same way that you might do with Google Webmaster Tools.

How to Add LLMS.txt to a WordPress Website

Notify Crawlers and Bots

Include the file in robots.txt and add a directive in your robots.txt file to point to your llms.txt. For example:

      

User-agent: *
Allow: /llms.txt

Integrate with Your Sitemap Manually

Locate your sitemap URL (e.g., https://example.com/sitemap_index.xml) and use a text editor or plugin to include the llms.txt file in your sitemap:

         


https://example.com/llms.txt
2024-12-04


Save the changes and re-submit the sitemap to search engines and LLM platforms (e.g., via Google Search Console or directly to LLM platforms if supported).

Automate via Plugins

Use a hook in WordPress to dynamically append the llms.txt file to your sitemap if supported by Rank Math or Yoast SEO.

Leverage Internal Linking

Encourage External Crawling

Optimize Crawling Speed

Monitor and Iterate

Implementation Example for WordPress