Free tools

Robots.txt Examples

Robots.txt file content for rottentomatoes.com.

Robot.txt file for: rottentomatoes.com

      User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Omgilibot
Disallow: /

User-agent: Omgili
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: *
Disallow: /search
Disallow: /critics/self-submission/
Sitemap: https://www.rottentomatoes.com/sitemaps/sitemap.xml