Robots.txt Generator

Create a robots.txt file to control search engine crawlers

Configure Rules
Set up crawler directives
Generated robots.txt
Save this as robots.txt in your root directory
User-agent: *
Allow: /