Free tools

Robots.txt Examples

Robots.txt file content for navitime.co.jp.

Robot.txt file for: navitime.co.jp

      User-agent: *
Disallow: /ja
Disallow: /affi

User-agent: Bingbot
Crawl-delay: 30