Free tools

Robots.txt Examples

Robots.txt file content for mozilla.org.

Robot.txt file for: mozilla.org

      user-agent: *
disallow: /*/firstrun/
disallow: /*/newsletter/existing/
disallow: /*/whatsnew/
disallow: /*/etc/
Sitemap: https://www.mozilla.org/sitemap.xml