Free tools

Robots.txt Examples

Robots.txt file content for top.rated.online.

Robot.txt file for: top.rated.online

      User-agent: *
Allow: /
Disallow: /?*
Disallow: /_zc
Crawl-delay: 120