Free tools
Robots.txt Examples
Robots.txt file content for glamourmagazine.co.uk.
Robot.txt file for: glamourmagazine.co.uk
User-agent: * Disallow: /search Disallow: /preview/ Disallow: /5574* Disallow: /xhr/ Disallow: /*?redirectURL= Disallow: /*{{section}} Disallow: /*%7B%7Bsection%7D%7D Disallow: /auth/* Disallow: /account/* Disallow: /product/ Disallow: /user-context?referrer Disallow: /services.min.js?_= Disallow: /com.condenast/yv8* User-agent: Google-InspectionTool Allow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Amazonbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: Omgilibot Disallow: / User-agent: omgili Disallow: / User-agent: PerplexityBot Disallow: / User-agent: YouBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: Applebot-Extended Disallow: / Sitemap: https://www.glamourmagazine.co.uk/sitemap.xml Sitemap: https://www.glamourmagazine.co.uk/feed/rss Sitemap: https://www.glamourmagazine.co.uk/feed/google-latest-news/sitemap-google-news Sitemap: https://www.glamourmagazine.co.uk/discountcodes/sitemap.xml Sitemap: https://www.glamourmagazine.co.uk/categories-sitemap.xml Sitemap: https://www.glamourmagazine.co.uk/contributors-sitemap.xml Sitemap: https://www.glamourmagazine.co.uk/branded-sitemap.xml Sitemap: https://www.glamourmagazine.co.uk/sitemap-archive-1.xml Sitemap: https://www.glamourmagazine.co.uk/bundles-sitemap.xml