features

Understanding LLMs.txt

Learn what LLMs.txt is and how it helps AI assistants discover and recommend your content.

What is LLMs.txt?

llms.txt is a standardized file that helps AI assistants understand your website. Just as robots.txt guides search engine crawlers, llms.txt provides context for large language models (LLMs) like ChatGPT, Claude, and Perplexity.

The file lives at the root of your site:

text
https://yoursite.com/llms.txt

Why This Matters

llms.txt is the map an assistant reads first. Without it, a model has to guess which of

your pages matter and what your site is for. llms-full.txt carries the detail behind the

map, so an assistant can answer about your pages without fetching each one.

Why LLMs.txt Matters

AI Assistants Need Context

When someone asks an AI assistant about travel tours, local services, or products, the AI needs reliable information to make recommendations. Without proper context, AI might:

  • Miss your website entirely
  • Provide outdated information
  • Misrepresent your offerings
  • Recommend competitors instead
  • LLMs.txt Provides Context

    Your LLMs.txt file tells AI assistants:

  • What your business does
  • What pages exist on your site
  • What each page contains
  • How to accurately describe your offerings
  • File Format

    AIO Radar generates LLMs.txt following the standard format:

    text
    # Your Site Name
    
    > A brief description of your business and what you offer.
    
    ## Pages
    
    - Page Title: /url-path
      AI-optimized summary of the page content...
    
    - Another Page: /another-path
      Description of what this page covers...
    
    ## Contact
    
    - Email: contact@yoursite.com
    - Phone: +1 (555) 123-4567

    Sections Explained

    SectionPurpose
    Header (#)Your site/business name
    Blockquote (>)Brief description of your business
    PagesList of pages with URLs and summaries
    ContactHow to reach your business

    LLMs.txt vs LLMs-full.txt

    AIO Radar generates two files:

    llms.txt

  • Concise summaries of each page
  • Optimized for quick AI comprehension
  • Ideal for initial discovery and recommendations
  • llms-full.txt

  • Complete content from each page
  • Detailed information for deep analysis
  • Useful when AI needs comprehensive answers
  • Both are automatically served by the plugin.

    Generation Process

    When you generate LLMs.txt, AIO Radar:

  • Fetches your synced page inventory
  • Analyzes content for key information
  • Generates AI-optimized summaries using GPT-4 or Claude
  • Formats content according to the standard
  • Caches the result for fast serving
  • Choosing an AI Provider

    Generate with different providers at AIO Radar → LLMs.txt → Settings:

    ProviderModelBest For
    OpenAIGPT-4oGeneral use, fast generation
    AnthropicClaude 3Detailed, nuanced summaries
    GoogleGemini ProMultilingual sites

    Managing LLMs.txt

    Regenerate

    Update your LLMs.txt when content changes significantly:

  • Go to AIO Radar → LLMs.txt
  • Click Regenerate
  • Wait for new content (30-60 seconds)
  • Or via WP-CLI:

    bash
    wp aio llms-txt generate --force

    Auto-Regeneration

    Enable automatic updates at AIO Radar → Settings → LLMs.txt:

    SettingDescription
    Auto-regenerate on syncUpdate when content syncs
    Cache durationHow long to cache content

    Exclude Pages

    Exclude pages from LLMs.txt at AIO Radar → Settings → Content:

  • Exclude by category
  • Exclude by post type
  • Exclude individual pages via post meta
  • Viewing Your File

    Browser Preview

    Visit these URLs to see your generated files:

  • https://yoursite.com/llms.txt
  • https://yoursite.com/llms-full.txt
  • Admin Preview

    Preview in WordPress at AIO Radar → LLMs.txt:

  • View generated content
  • See page count and statistics
  • Check generation date
  • WP-CLI

    bash
    # View LLMs.txt content
    wp aio llms-txt show
    
    # Get just the URL
    wp aio llms-txt url

    Troubleshooting

    404 Error on /llms.txt

    Solution: Flush rewrite rules

  • Go to Settings → Permalinks
  • Click Save Changes
  • Or: wp rewrite flush

    Empty or Missing Content

    Possible causes:

  • No pages synced yet - run a scan first
  • All pages excluded - check exclusion settings
  • Generation failed - check error logs
  • Outdated Content

    Solution: Force regeneration

    bash
    wp aio llms-txt generate --force

    Or click Regenerate in the admin panel.

    Best Practices

    Keep Content Current

  • Enable auto-sync for real-time updates
  • Regenerate monthly or when making significant changes
  • Review summaries for accuracy
  • Optimize Page Content

    Better source content leads to better AI summaries:

  • Write clear, descriptive titles
  • Include key information early in content
  • Use structured headings (H2, H3)
  • Add relevant keywords naturally
  • Monitor AI Visibility

    After implementing LLMs.txt:

  • Track AI mentions in your dashboard
  • Monitor visibility trends
  • Compare against competitors