Free tools

Robots.txt Examples

Robots.txt file content for kiddle.co.

Robot.txt file for: kiddle.co

      User-agent: *
Disallow: /widget.php
Disallow: /privacy.php
Disallow: /m/
Disallow: /s.php
Disallow: /i.php
Disallow: /c.php
Disallow: /v.php
Disallow: /k.php
Disallow: /n.php

User-agent: ia_archiver
Disallow: /