Robots.txt Generator
InstantCreate a robots.txt with per-bot rules, sitemap lines and one-click presets for blocking or allowing AI crawlers.
- Runs in your browser
- Nothing is uploaded
- Copy-ready output
- Free to use
1
Start from a template
Pick the closest setup — you can edit every rule below.
2
Decide on AI crawlers
Choose whether ChatGPT, Claude, Perplexity and Gemini may read your site.
3
Fine-tune rules
One group per crawler. Most specific path wins; Allow beats Disallow on a tie.
4
Point crawlers to your sitemap
Ignored by Google
robots.txt1 group · 3 rules · 101 B
1User-agent: *
2Disallow: /admin/
3Disallow: /search
4Allow: /
5
6Sitemap: https://example.com/sitemap.xml
7
Live validation
ValidNo syntax problems. Upload it to the root of your domain as /robots.txt.
Need it fixed for you?