Free tools

Robots.txt Examples

Robots.txt file content for umich.edu.

Robot.txt file for: umich.edu

      User-agent: *
Disallow: /admin/
Disallow: /announcements/
Disallow: /pingtest/
Disallow: /search