Free tools

Robots.txt Examples

Robots.txt file content for tvguide.com.

Robot.txt file for: tvguide.com

      User-agent: AhrefsBot
Disallow: /

User-agent: AwarioRssBot
User-agent: AwarioSmartBot
Disallow: /

User-agent: barkrowler
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: DataForSeoBot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: ImagesiftBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: TurnitinBot
Disallow: /

User-agent: *
Disallow: /user/
Disallow: /watchlist/
Disallow: /s/
Disallow: /rss/

Sitemap: https://www.tvguide.com/news/latest.xml
Sitemap: https://www.tvguide.com/news/index.xml
Sitemap: https://www.tvguide.com/galleries/index.xml
Sitemap: https://www.tvguide.com/celebrities.xml
Sitemap: https://www.tvguide.com/movies.xml
Sitemap: https://www.tvguide.com/tvshows.xml