Free tools
Robots.txt Examples
Robots.txt file content for radiotimes.com.
Robot.txt file for: radiotimes.com
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /4817/ Disallow: /176986657/ Disallow: /styleguide/ Disallow: /author/mrben Disallow: /members/ Disallow: /search/ Disallow: /account/ Disallow: /logout Disallow: /register Disallow: /signin Disallow: /user-settings Disallow: /health Disallow: /myradiotimes/ Disallow: /newsletter/ Disallow: /win/ Disallow: /characters/ Disallow: /broadcast-programme/ Disallow: /topic/ Disallow: /radio/radio-listings/?sd= Disallow: /tv/tv-listings/?sd= Disallow: /tv/tv-listings?sc= Disallow: /v1/ Disallow: /auth/ Disallow: /wp-sitemap-posts- Disallow: /user/ Disallow: /api/articles/ Disallow: /api/broadcast/broadcast/details/ Disallow: /api/broadcast/posts/show/ Disallow: /movie-guide/ Disallow: /programme/ Disallow: /registration Disallow: /registration/ Disallow: /forgotten-password Disallow: /forgotten-password/ Disallow: /change-password/ Disallow: /reset-password Disallow: /reset-password/ Disallow: /app/ Disallow: /app/editors-choice/ Disallow: /app/features/ Disallow: /app/app-podcasts/ Disallow: /app/top-10/ Disallow: /app-olympics/ Disallow: /login Disallow: /login/ Disallow: /log-out Disallow: /log-out/ Disallow: /programmes/ Disallow: /franchise/ Disallow: /people/ Disallow: /v5/ # GPTBot User-agent: GPTBot Disallow: / # News Sitemap Sitemap: https://www.radiotimes.com/google-news.xml/ # Sitemap archive Sitemap: https://www.radiotimes.com/sitemap.xml