Robots.txt Generator

Quickly generate a robots.txt file to control how search engines crawl and index your website. Secure your admin directories and prioritize crawl budget.

Default Rule (All Bots)

Allow AllDisallow All

Disallowed Directories (one per line)

Crawl-Delay (Seconds - Optional)

XML Sitemap URL

robots.txt Output

User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /wp-admin/