Free tools

Robots.txt Examples

Robots.txt file content for casetext.com.

Robot.txt file for: casetext.com

      User-agent: *
Sitemap: https://casetext.com/sitemaps/index.xml
Sitemap: https://casetext.com/sitemaps/marketing-routes.xml
Sitemap: https://casetext.com/blog/sitemap_index.xml
Disallow: /api
Disallow: /search
Disallow: /users
Disallow: /orgs
Disallow: /_print
Disallow: */how-cited