Robots.txt Generator
Build a correct robots.txt for your website with a friendly form. Runs 100% in your browser.
Tip: add one rule per bot + path, for example Disallow /admin/ for all bots (*).
How to use
- For a simple open site, keep Allow all on and just add your sitemap URL.
- To block areas, turn it off and add rules: pick a bot, choose Disallow or Allow, and type a path like /admin/.
- Copy the generated file or download it, then upload it to the root of your website (https://example.com/robots.txt).
Frequently Asked Questions (FAQ)
What does the robots.txt generator do?
It builds a correct robots.txt file for your website with a friendly form — allow or disallow rules per bot plus your sitemap URL. It runs 100 percent in your browser.
Which bots can I target?
Googlebot, Bingbot, DuckDuckBot, GPTBot, CCBot, or all bots at once with the star (*) rule.
Do I need to upload anything to use it?
No. But to use the file, copy or download it and place it at the root of your website — for example, https://example.com/robots.txt.
What is simple mode?
For a simple open site, keep Allow all bots on and just add your sitemap URL. To block areas, turn it off and add per-bot rules — one rule per bot and path, like Disallow /admin/ for all bots.