Free tools

Robots.txt Examples

Robots.txt file content for howstuffworks.com.

Robot.txt file for: howstuffworks.com

      User-agent: *
Disallow: /framed.htm
Disallow: /editor/

User-agent: Mediapartners-Google
Disallow:

Sitemap: https://www.howstuffworks.com/www-sitemap-index.xml