Free tools

Robots.txt Examples

Robots.txt file content for cancer.gov.

Robot.txt file for: cancer.gov

      sitemap: https://www.cancer.gov/sitemap.xml
User-agent: *