Free tools

Robots.txt Examples

Robots.txt file content for berkeley.edu.

Robot.txt file for: berkeley.edu

      # START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow:

Sitemap: https://www.berkeley.edu/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK