Free tools

Robots.txt Examples

Robots.txt file content for w3schools.com.

Robot.txt file for: w3schools.com

      User-agent: Mediapartners-Google 
Disallow:

User-agent: *
Disallow: /images
Disallow: /asp/demo_db_edit.asp
Disallow: *.aspx$
Disallow: /code/