Free tools
Robots.txt Examples
Robots.txt file content for screenrant.com.
Robot.txt file for: screenrant.com
User-agent: * Disallow: /pixel.png* Disallow: /search/ Disallow: /profile/ User-agent: GPTBot Disallow: / Sitemap: https://screenrant.com/sitemap.xml