Free tools

Robots.txt Examples

Robots.txt file content for movieweb.com.

Robot.txt file for: movieweb.com

      User-agent: *
Disallow: /pixel.png*
Disallow: /search/
Disallow: /profile/
User-agent: GPTBot
Disallow: /
Sitemap: https://movieweb.com/sitemap.xml