Free tools

Robots.txt Examples

Robots.txt file content for vocabulary.com.

Robot.txt file for: vocabulary.com

      User-agent: *
Disallow: /account/
Disallow: /ui/
Disallow: /auth/
Disallow: /challenge/
Disallow: /login/
Disallow: /signup/
Disallow: /join/

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Applebot-Extended
Disallow: /