Free tools

Robots.txt Examples

Robots.txt file content for shabdkosh.com.

Robot.txt file for: shabdkosh.com

      User-agent: Amazonbot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: AhrefsBot
Disallow: / 

User-agent: dotbot
Disallow: /

User-agent: Riddler
Disallow: /

User-agent: *
Disallow: /login

User-agent: Googlebot
Allow: /
Disallow: /login

User-agent: GPTBot
Disallow: /

User-agent: Yandexbot
Disallow: /