Developer tool
Robots.txt Generator
Choose crawler rules and optionally enter a sitemap URL to create a plain-text draft.
Runs in your browser. No upload.
Values are processed locally in this browser.
Result
About this tool
Robots.txt Generator made simple.
Robots.txt is a crawl directive, not access control. Do not use it to protect private files; verify syntax and intended paths before publishing.
Common questions
About Robots.txt Generator.
How do I use Robots.txt generator?
Choose crawler rules and optionally enter a sitemap URL to create a plain-text draft.
Is my data uploaded to a server?
No. This tool runs locally in your browser. Your input is not uploaded.