SEO Tools/Robots.txt Generator

Robots.txt Generator

Create and customize robots.txt for search engine crawlers

User-Agent

Allow Paths

One path per line

Disallow Paths

One path per line

Sitemap URL

Crawl Delay (seconds)

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/
Disallow: /api/

Sitemap: https://example.com/sitemap.xml

Save as robots.txt in your website root directory