Free tools

Robots.txt Examples

Robots.txt file content for livestrong.com.

Robot.txt file for: livestrong.com

      User-agent: *
Allow: /myplate/$
Disallow: /myplate/
Disallow: /swf/
Disallow: /search/
Disallow: /profile/
Disallow: /thedailyplate/
Disallow: /thedailyplate/nutrition-calories/
Disallow: /thedailyplate/diary/
Disallow: /thedailyplate/users/
Disallow: /thedailyplate/search*
Disallow: /prof/
Disallow: /service/
Disallow: /memberSearch/
Disallow: /api/
Disallow: /sem/
Disallow: /ads/
Disallow: /6117/
Disallow: /hl/
Disallow: /healthline/
Disallow: /joinmyplate/
Disallow: */customize/
Disallow: /embed/
Disallow: /livestrong/ui/iframefb/
Disallow: /livestrong/ui/iframeads/
Disallow: /new-admin/
Disallow: /stronger-videos/
Disallow: /blog/
Disallow: /videos/

User-agent: Mediapartners-Google
Disallow:

Sitemap: https://www.livestrong.com/sitemaps/sitemap.xml