Guide9 min read
llms.txt v2: What Changed
Every change from v1 to v2 of the llms.txt specification — link relations, subpath coverage, relaxed .md URLs — and what to do about each.
Read more →
LLMs.txt Blog
Learn everything about llms.txt files, AI optimization, and best practices for making your website discoverable by Large Language Models.
Featured Guide
Complete Guide to LLMs.txt: Everything You Need to Know
Start here if you're new to llms.txt. This comprehensive guide covers everything from basic concepts to advanced implementation strategies.
Read the Guide →Guide11 min read
Control AI Crawlers with robots.txt
The per-vendor user-agent list, and the mistake that removes you from AI answers while you are trying to opt out of training.
Read more →
Standards8 min read
Content Signals and IETF AIPREF
Saying what AI may do with content it is allowed to fetch — Cloudflare Content Signals, the AIPREF Content-Usage draft, and which to deploy now.
Read more →
Comparison9 min read
ai.txt: Two Competing Standards
Two unrelated specifications share the filename ai.txt. How to tell them apart, and which one solves your problem.
Read more →
SEO7 min read
Lighthouse Agentic Browsing and llms.txt
Google Search says llms.txt does nothing for rankings while Chrome Lighthouse audits it. Both are true — here is what the audit checks.
Read more →
Case Study10 min read
Case Study: MorseKit and 27 Languages
A section-by-section read of a real 12 KB llms.txt, and why its statements about what does NOT exist matter more than its links.
Read more →
Case Study9 min read
Case Study: The ai.txt That Argues Against Itself
A published ai.txt with a "Clear limitations" section and instructions telling assistants to present the competition fairly — and why that works.
Read more →
Case Study10 min read
Case Study: Defending a Generic Brand Name
Search Wikidata for "First Point" and you get capes and peninsulas. How ai.txt stops assistants merging a company with strangers that share its name.
Read more →
Resources6 min read
index.guru: The Curated AI Directory
A curated index of AI accounts, bots, apps, and communities across every major platform — and how to get listed.
Read more →
Tutorial14 min read
Automate LLMs.txt Generation
Generate llms.txt automatically from your CMS, build pipeline, or static site generator.
Read more →
E-Commerce12 min read
LLMs.txt for Ecommerce Sites
How online stores can structure llms.txt for product discovery and AI shopping assistants.
Read more →
Analytics10 min read
Measure the Impact of LLMs.txt
Metrics and methods to track whether AI systems are actually using your llms.txt file.
Read more →
Comparison15 min read
LLMs.txt vs Sitemap.xml
Comparing llms.txt and XML sitemaps, and how they complement each other for discovery.
Read more →
Best Practices12 min read
LLMs.txt Best Practices
Proven patterns and conventions that make llms.txt files more useful to AI systems.
Read more →
Tutorial10 min read
How to Implement LLMs.txt on Your Site
Step-by-step implementation guide for adding llms.txt to any website or framework.
Read more →
Security8 min read
What is Security.txt?
A companion convention to llms.txt — how security.txt helps researchers report vulnerabilities.
Read more →
Guide10 min read
Complete Guide to LLMs.txt
Everything you need to know about llms.txt files — what it is, why it matters, and how to create one.
Read more →
Comparison7 min read
LLMs.txt vs Robots.txt
How llms.txt differs from robots.txt — and why most sites need both.
Read more →
Tutorial12 min read
Optimize Your Website for AI
Beyond llms.txt: a broader playbook for making any site AI-readable and citation-friendly.
Read more →
Best Practices8 min read
Common LLMs.txt Mistakes to Avoid
The most frequent errors that invalidate or weaken an llms.txt file, and how to fix them.
Read more →
SEO6 min read
SEO Benefits of LLMs.txt
How llms.txt supports Generative Engine Optimization and AI search visibility.
Read more →
Ready to Validate Your LLMs.txt File?
Use our free validator to ensure your llms.txt file meets the official standard and is optimized for AI systems.
Try the Validator →