Free tools

Robots.txt Examples

Robots.txt file content for elsevier.es.

Robot.txt file for: elsevier.es

      # Hi, you're in the journals site

User-Agent: *
Allow: /