← All SEO tools SEO Tool

Robots.txt Generator

Tell search engines what to crawl. Build a correct robots.txt and drop it at the root of your domain.

Rules

Default access

User-agent

Disallow paths one per line

Allow paths optional, one per line

Crawl-delay sec

Sitemap URL

Upload the file to your site root so it's reachable at yourdomain.com/robots.txt.