Free tools

Robots.txt Examples

Robots.txt file content for radiotimes.com.

Robot.txt file for: radiotimes.com

      User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.radiotimes.com/wp-sitemap.xml
Disallow: /4817/
Disallow: /176986657/
Disallow: /styleguide/
Disallow: /author/mrben
Disallow: /members/
Disallow: /search/
Disallow: /account/
Disallow: /logout
Disallow: /register
Disallow: /signin
Disallow: /user-settings
Disallow: /health
Disallow: /myradiotimes/
Disallow: /newsletter/
Disallow: /win/
Disallow: /characters/
Disallow: /broadcast-programme/
Disallow: /topic/
Disallow: /radio/radio-listings/?sd=
Disallow: /tv/tv-listings/?sd=
Disallow: /tv/tv-listings?sc=
Disallow: /v1/
Disallow: /auth/
Disallow: /wp-sitemap-posts-
Disallow: /user/
Disallow: /api/articles/
Disallow: /api/broadcast/broadcast/details/
Disallow: /api/broadcast/posts/show/
Disallow: /movie-guide/
Disallow: /programme/
Disallow: /registration
Disallow: /registration/
Disallow: /forgotten-password
Disallow: /forgotten-password/
Disallow: /change-password/
Disallow: /reset-password
Disallow: /reset-password/


# GPTBot
User-agent: GPTBot
Disallow: /

# News Sitemap
Sitemap: https://www.radiotimes.com/google-news.xml/

# Sitemap archive
Sitemap: https://www.radiotimes.com/sitemap.xml

# Sitemap archive
Sitemap: https://www.radiotimes.com/sitemaps/shows.xml
# Sitemap archive
Sitemap: https://www.radiotimes.com/sitemap.xml