Strategies for adding your llms.txt
file to your website so that it gets indexed quickly (includes WordPress integration options). We are advocating for the option to provide the file directly to OpenAI or Perplexity or to request a crawl in the same way that you might do with Google Webmaster Tools.
Include the file in robots.txt
and add a directive in your robots.txt
file to point to your llms.txt
. For example:
User-agent: *
Allow: /llms.txt
Locate your sitemap URL (e.g., https://example.com/sitemap_index.xml
) and use a text editor or plugin to include the llms.txt
file in your sitemap:
https://example.com/llms.txt
2024-12-04
Save the changes and re-submit the sitemap to search engines and LLM platforms (e.g., via Google Search Console or directly to LLM platforms if supported).
Use a hook in WordPress to dynamically append the llms.txt
file to your sitemap if supported by Rank Math or Yoast SEO.
llms.txt
file to increase its visibility to crawlers.llms.txt
:
llms.txt
file on social media or in industry communities.llms.txt
.llms.txt
.llms.txt
URL.llms.txt
file if allowed.functions.php
file to dynamically include llms.txt
in your sitemap:
add_filter('wpseo_sitemap_entry', function($url) {
$url[] = [
'loc' => home_url('/llms.txt'),
'lastmod' => date('c'),
];
return $url;
});