Robots.txt Generator
Build a clean robots.txt with custom rules, sitemap URLs and tested presets for WordPress and more.
- Runs in your browser
- No upload on server
- Free, forever
- Paste input
- Run
- Copy result
How this works
- 1Pick what to allow
Choose which bots can crawl and which paths are off-limits. Sensible defaults are pre-filled.
- 2Preview the file
See exactly what robots.txt will contain, line by line, before you save it.
- 3Download robots.txt
Save the file and upload it to the root of your site (yoursite.com/robots.txt).
Watch: form → robots.txt file
Rules
robots.txt
User-agent: * Allow: / Sitemap: https://example.com/sitemap.xml
Upload the file to the root of your site so it lives at /robots.txt.
How this works — and why it's private
- Add a rule group for each crawler you want to control.
- List paths to Allow or Disallow — one per line.
- Copy or download the file and place it at your site root.
Rate Robots.txt Generator
One tap. Anonymous. Helps others find the good tools.
No account, no email, no tracking — just a 1–5 number.
Be the first to rate