Free tools

Robots.txt Examples

Robots.txt file content for springer.com.

Robot.txt file for: springer.com

      User-agent: *
Allow: /
Allow: /$
Disallow: */product-search*
Disallow: */search*
Disallow: */product-marketing-tool/*
Disallow: */booksellers/forthcoming-titles-alert*
Disallow: */1000$
Disallow: *wicket:interface*