Free tools

Robots.txt Examples

Robots.txt file content for famousbirthdays.com.

Robot.txt file for: famousbirthdays.com

      User-agent: *
Disallow: /people/edits
Disallow: /groups/edits
Disallow: /api/
Disallow: /app/
Disallow: /search
Disallow: /random
Disallow: /random-group/
Disallow: /people/@
Disallow: /pending/
Disallow: /people/user1
Disallow: /people/user2
Disallow: /people/user3
Disallow: /people/user4
Disallow: /people/user5
Disallow: /people/user6
Disallow: /people/user7
Disallow: /people/user8
Disallow: /people/user9
Disallow: /contact/submit
Disallow: /20602751/
Disallow: /doubleclick/
Disallow: /thumbnails/
Sitemap: https://www.famousbirthdays.com/fb-sitemap.xml