Free tools

Robots.txt Examples

Robots.txt file content for powerthesaurus.org.

Robot.txt file for: powerthesaurus.org

      User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: Omgilibot
Disallow: /

User-Agent: FacebookBot
Disallow: /

User-agent: *
Disallow: /_search
Disallow: /_add
Disallow: /_api

Sitemap: https://www.powerthesaurus.org/xml/sitemap1.xml.gz
Sitemap: https://www.powerthesaurus.org/sitemap.index.xml