November 26, 2024

Robots.txt for clarin.com

        User-agent: *
Disallow: /api/
Disallow: /redaccionfiler/*
Disallow: /viafoura/*
Disallow: /autor/*?
Disallow: /videos/*?
Disallow: /videoloop/*_3_

Sitemap: https://www.clarin.com/sitemaps/index.xml
Sitemap: https://www.clarin.com/sitemaps/index_services.xml
Sitemap: https://www.clarin.com/sitemaps/sitemap_google_news.xml