Robots.txt Generator
Create a valid robots.txt file for your website: set allow/disallow paths, add your sitemap URL and crawl-delay, then download.
Runs 100% in your browser. Upload the generated file as robots.txt in your website's root folder.
How to use
The Robots.txt Generator is a free online tool — no sign-up or download is required. Create a valid robots.txt file for your website: set allow/disallow paths, add your sitemap URL and crawl-delay, then download.
- Fill in the User-agent (default * = all crawlers) and your allow/disallow paths, one per line.
- Optionally add your sitemap URL and a crawl-delay, then click Generate robots.txt.
- Use Copy or Download robots.txt to save the file, then upload it to your site root.
Frequently asked questions
What does the Robots.txt Generator do?
Create a valid robots.txt file for your website: set allow/disallow paths, add your sitemap URL and crawl-delay, then download.
How do I use the Robots.txt Generator?
Open the Robots.txt Generator page, enter or upload your input using the form above, then click the main action button to get your result instantly. You can copy or download the result when you are done. No sign-up or installation is needed.
Is the Robots.txt Generator free to use?
Yes. The Robots.txt Generator is completely free, like every tool on SEO Tools by metacalculator.org. There is no sign-up, no watermark and no hidden limits.
Is my data private when I use the Robots.txt Generator?
Yes. This tool runs entirely in your browser, so your input never leaves your device. Nothing is uploaded, stored or shared.