Free tools

Robots.txt Examples

Robots.txt file content for pa.gov.

Robot.txt file for: pa.gov

      # START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow:

Sitemap: https://www.pa.gov/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK