Free tools
Robots.txt Examples
Robots.txt file content for rocketreach.co.
Robot.txt file for: rocketreach.co
# robots.txt for http://rocketreach.co/ User-agent: * Disallow: /scss/ #precompiles scss files Disallow: /search$ Disallow: /search?* Disallow: /person$ Disallow: /person?* Disallow: /company$ Disallow: /company?* Disallow: /account$ Disallow: /account?* Disallow: /login$ Disallow: /login?* Disallow: /signup$ Disallow: /signup?* Disallow: /perf_* Disallow: /v1/* Disallow: /v2/* Allow: /v1/user # robots.txt for http://rocketreach.co/