Free tools

Robots.txt Examples

Robots.txt file content for lovetoknow.com.

Robot.txt file for: lovetoknow.com

      
User-agent: *
Disallow: /1004147*
Disallow: /frontend.
Disallow: /frontend_
Disallow: /backend.
Disallow: /backend_
Disallow: /css/
Disallow: /js/
Disallow: /sf/
Disallow: /print/
Disallow: /search?
Disallow: /image/
Disallow: /advice$
Disallow: /advice/
Disallow: /botCheck.json


User-agent: Mediapartners-Google
Disallow: /index.
Disallow: /wiki/index.
Disallow: /frontend.
Disallow: /frontend_
Disallow: /backend.
Disallow: /backend_
Disallow: /css/
Disallow: /js/
Disallow: /sf/
Disallow: /print/
Disallow: /search?
Disallow: /advice$
Disallow: /advice/
Disallow: /botCheck.json

Sitemap: https://www.lovetoknow.com/sitemap-index.xml