Free tools
Robots.txt Examples
Robots.txt file content for casetext.com.
Robot.txt file for: casetext.com
User-agent: * Sitemap: https://casetext.com/sitemaps/index.xml Sitemap: https://casetext.com/sitemaps/marketing-routes.xml Sitemap: https://casetext.com/blog/sitemap_index.xml Disallow: /api Disallow: /search Disallow: /users Disallow: /orgs Disallow: /_print Disallow: */how-cited