Free tools
Robots.txt Examples
Robots.txt file content for powerthesaurus.org.
Robot.txt file for: powerthesaurus.org
User-agent: * Disallow: /_search Disallow: /_add Disallow: /_api
Robots.txt file content for powerthesaurus.org.
User-agent: * Disallow: /_search Disallow: /_add Disallow: /_api