Free tools

Robots.txt Examples

Robots.txt file content for openedition.org.

Robot.txt file for: openedition.org

      User-agent: *
Disallow: /scripts/
Disallow: /lodel/
Disallow: /book-title-list.html
Sitemap: http://www.openedition.org/?page=sitemap