AI SEO · Generative Engine Optimization (GEO)
Generate
llms.txt
for Large Websites
Crawl your sitemap, categorize hundreds of pages, and produce a spec-compliant
llms.txt
file — so ChatGPT, Claude, and Perplexity understand your site.
generator.php
01
Sitemap Discovery
Reads robots.txt, parses nested sitemap index files, collects all page URLs.
02
Smart Prioritization
Shallower pages ranked higher. Removes duplicates and query-string variants.
03
Metadata Extraction
Concurrent HTTP fetching of titles, OG descriptions and H1 tags.
04
File Generation
Outputs spec-compliant llms.txt and llms-full.txt ready to deploy.
Recent Generations
| Domain | Date | Action |
|---|---|---|
| www.12grids.com | 1 hour ago | View → |