Free tools

Robots.txt Examples

Robots.txt file content for giphy.com.

Robot.txt file for: giphy.com

      User-agent: Yandex
Disallow: /gifs
User-agent: PetalBot
Disallow: /