Free tools
Robots.txt Examples
Robots.txt file content for globalnews.ca.
Robot.txt file for: globalnews.ca
Sitemap: http://globalnews.ca/news-sitemap.xml Sitemap: https://globalnews.ca/?feed=sitemapsimple Sitemap: https://globalnews.ca/videos/sitemap/ User-agent: * Disallow: /tag/sochi-olympics/ Disallow: /gnca-ajax-redesign/showcase-image/ User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php