Free tools

Robots.txt Examples

Robots.txt file content for hatenablog.com.

Robot.txt file for: hatenablog.com

      User-agent: *
Allow: /*
Disallow: /dev/api/internal/
Disallow: /api/
Allow: /api/diary_redirect