Developer

ROBOTS.TXT Generator

Build a robots.txt file with multiple user-agent rules, allow/disallow paths, crawl delay, and sitemap URL. Use presets or build from scratch.

Quick Presets

Sitemap URL (optional)

Crawl Delay (global, seconds — optional)

Applied to all user-agent groups that don't specify their own

robots.txt Preview