Free tools

Robots.txt Examples

Robots.txt file content for ucla.edu.

Robot.txt file for: ucla.edu

      User-agent: *
Disallow:

Sitemap: https://www.ucla.edu/sitemap.xml