Free tools

Robots.txt Examples

Robots.txt file content for howtopronounce.com.

Robot.txt file for: howtopronounce.com

      User-Agent: SemrushBot
crawl-delay: 9

User-Agent: Trident
crawl-delay: 9

User-agent: ltx71 - (http://ltx71.com/)
Disallow: /

User-Agent: *
Disallow: 
Allow: /