Free tools
Robots.txt Examples
Robots.txt file content for howtopronounce.com.
Robot.txt file for: howtopronounce.com
User-Agent: SemrushBot crawl-delay: 9 User-Agent: Trident crawl-delay: 9 User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-Agent: * Disallow: Allow: /