November 26, 2024

Robots.txt for illinois.edu

        User-agent: *
Disallow: /temp/ 
Disallow: /test/ 
Disallow: /mobile/