Free tools

Robots.txt Examples

Robots.txt file content for eurogamer.net.

Robot.txt file for: eurogamer.net

      User-agent: *
Disallow: /search?q=
Disallow: /search/
Disallow: /community/
Disallow: /*?view=comments
Disallow: /*?ajax=1
Disallow: /*?preview_key=
Disallow: /liveblog/
Disallow: /poll/*
Disallow: /mypop/
Disallow: /for-you/
Disallow: /competition/

Sitemap: https://www.eurogamer.net/sitemap.xml
Sitemap: https://www.eurogamer.net/sitemap-news.xml