Free tools

Robots.txt Examples

Robots.txt file content for washington.edu.

Robot.txt file for: washington.edu

      User-agent: *
Disallow: /?s=*
Disallow: /search/
Disallow: /graduation/?s=*