Free tools

Robots.txt Examples

Robots.txt file content for dotesports.com.

Robot.txt file for: dotesports.com

      User-agent: *
Allow: /
Disallow: /?s=*
Disallow: /search/*

User-agent: Googlebot-News
Disallow: /*/matches
Disallow: /*/organizations
Disallow: /*/players
Disallow: /*/rankings
Disallow: /*/teams
Disallow: /*/tournaments
Disallow: /search
Disallow: /tag/
Allow: /

Sitemap: https://dotesports.com/sitemap_index.xml
Sitemap: https://dotesports.com/sitemap-news.xml