Free tools

Robots.txt Examples

Robots.txt file content for thekitchn.com.

Robot.txt file for: thekitchn.com

      Sitemap: https://www.thekitchn.com/sitemap.xml
Sitemap: https://www.thekitchn.com/sitemap.googlenews.xml
Sitemap: https://www.thekitchn.com/stories/sitemap.xml

User-Agent: *

Disallow: /search?

User-agent: grapeshot
Disallow: