Free tools
Robots.txt Examples
Robots.txt file content for livestrong.com.
Robot.txt file for: livestrong.com
User-agent: * Allow: /myplate/$ Disallow: /myplate/ Disallow: /swf/ Disallow: /search/ Disallow: /profile/ Disallow: /thedailyplate/ Disallow: /thedailyplate/nutrition-calories/ Disallow: /thedailyplate/diary/ Disallow: /thedailyplate/users/ Disallow: /thedailyplate/search* Disallow: /prof/ Disallow: /service/ Disallow: /memberSearch/ Disallow: /api/ Disallow: /sem/ Disallow: /ads/ Disallow: /6117/ Disallow: /hl/ Disallow: /healthline/ Disallow: /joinmyplate/ Disallow: */customize/ Disallow: /embed/ Disallow: /livestrong/ui/iframefb/ Disallow: /livestrong/ui/iframeads/ Disallow: /new-admin/ Disallow: /stronger-videos/ Disallow: /blog/ Disallow: /videos/ User-agent: Mediapartners-Google Disallow: Sitemap: https://www.livestrong.com/sitemaps/sitemap.xml