Free tools
Robots.txt Examples
Robots.txt file content for famousbirthdays.com.
Robot.txt file for: famousbirthdays.com
User-agent: * Disallow: /people/edits Disallow: /groups/edits Disallow: /api/ Disallow: /app/ Disallow: /search Disallow: /random Disallow: /random-group/ Disallow: /people/@ Disallow: /pending/ Disallow: /people/user1 Disallow: /people/user2 Disallow: /people/user3 Disallow: /people/user4 Disallow: /people/user5 Disallow: /people/user6 Disallow: /people/user7 Disallow: /people/user8 Disallow: /people/user9 Disallow: /contact/submit Disallow: /20602751/ Disallow: /doubleclick/ Disallow: /thumbnails/ Sitemap: https://www.famousbirthdays.com/fb-sitemap.xml