robots.txt Generator

Build your robots.txt file visually and copy the result.

Rule 1

User-agent

Crawl-delay (optional)

Allow (one path per line)

Disallow (one path per line)

Sitemap URL

robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/

Sitemap: https://example.com/sitemap.xml