Robots.txt Generator

About this tool

Generate a simple robots.txt file with a crawl rule and optional sitemap URL. No account is required. Review important results before relying on them.

Privacy and usability

This utility is designed to perform its core calculation or transformation in your browser. Large files can require more memory and processing time.

More tools

Image tools • PDF tools • Text tools • Developer tools • Calculators