Free tools
Robots.txt Examples
Robots.txt file content for iheart.com.
Robot.txt file for: iheart.com
# Production User-agent: Mediapartners-Google Allow: /ads.txt User-Agent: facebookexternalhit Disallow: /_/ Disallow: /a/ Disallow: /misc/ User-agent: * Disallow: /_/ Disallow: /a/ Disallow: /amp/ Disallow: /misc/ Disallow: /search/ Disallow: /*/itunes/ Disallow: /*/amazon/ Disallow: /login/ Disallow: /userInfo/ Disallow: /family-validation/ Sitemap: https://www.iheart.com/sitemap.xml User-agent: * User-agent: Googlebot-News Sitemap: https://www.iheart.com/news_sitemap.xml