Robots.txt Generator
Generate clean robots.txt rules for search engines.
Configure your rules
Website URL (optional but recommended)
Used to suggest Sitemap URL. Example: https://example.com/
User-agent
All bots (*)
Googlebot
Bingbot
Googlebot-Image
Custom…
Rule Template
Allow all (recommended for most sites)
Disallow all (block crawling)
Custom rules
Disallow paths (one per line)
Allow paths (optional)
Quick extras
Block common sensitive paths
Include comment header
Crawl-delay (seconds):
Auto-generate sitemap URL from domain
Sitemap URLs (one per line)
Generate robots.txt
Clear form
robots.txt Output
No robots.txt generated yet.
Copy
Download
Reset