SEO Tools

Robots.txt Generator

Generate a robots.txt — allow/disallow paths, block AI crawlers, add your sitemap.

About the Robots.txt Generator

The Robots.txt Generator builds a correct robots.txt from checkboxes: disallowed paths, optional blocking of AI training crawlers (GPTBot, CCBot & co.) and your sitemap URL. Test the result with the Robots.txt Tester.

It prevents crawling, not indexing — a blocked URL can still appear (without snippet) if linked elsewhere. Use noindex for real exclusion.

Your call: blocking GPTBot & co. keeps content out of future training sets but has no effect on normal search rankings.