Free tools

Robots.txt Examples

Robots.txt file content for unc.edu.

Robot.txt file for: unc.edu

      # START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow:

Sitemap: https://www.unc.edu/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK