06 / Tools Robots.txt Generator

Robots.txt Generator.

Build a robots.txt file with user-agent rules, presets for AI bots, sitemap URL, and crawl-delay.

Presets

User-Agent Rules

Global Settings

Sitemap URL

Crawl-Delay (seconds, optional)

Generated robots.txt

# robots.txt

Copied!