Free tools

Robots.txt Examples

Robots.txt file content for cbr.com.

Robot.txt file for: cbr.com

      User-agent: *
Disallow: /pixel.png*
Disallow: /search/
Disallow: /profile/
User-agent: GPTBot
Disallow: /
Sitemap: https://www.cbr.com/sitemap.xml