Free tools

Robots.txt Examples

Robots.txt file content for britannica.com.

Robot.txt file for: britannica.com

      # /robots.txt file for encyclopaedia britannica 

Sitemap: https://www.britannica.com/bps-ssl-gsm-index.xml 

User-agent: * 
Disallow: /search