Free tools
Robots.txt Examples
Robots.txt file content for eatingwell.com.
Robot.txt file for: eatingwell.com
User-agent: * Disallow: *quizResult= Disallow: *.pdf Disallow: *globeTest_ Disallow: *globeNoTest Disallow: *globeResource Disallow: *?kw Disallow: /embed? Disallow: /shop/ Disallow: /authentication/ Disallow: /newsletters/preferences/manage Disallow: /newsletters/preferences/unsubscribe Disallow: /node* Disallow: /?q=node Disallow: /?q=node/ Disallow: /?q=admin/ Disallow: /?q=comment/reply/ Disallow: /?q=filter/tips/ Disallow: /?q=node/add/ Disallow: /?q=search/ Disallow: /?q=user/password/ Disallow: /?q=user/register/ Disallow: /?q=user/login/ Disallow: /?q=user/logout/ Disallow: /embed Disallow: /oembed Disallow: /dyn/ Disallow: /labs/ Disallow: /order/ Disallow: /child/ Disallow: /photos/ Disallow: /common/ Disallow: /content/ Disallow: /private/ Disallow: /premium/ Disallow: /partner/ Disallow: /templates/ Disallow: /community/kudos/ Disallow: /community/user/ Disallow: /templatedata/ Disallow: /videos/theme/ Disallow: /videos/widgets/ Disallow: /go? Disallow: /nutrition-search-result User-agent: Pinterest Disallow: User-agent: Pinterestbot Disallow: User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: /thmb/ User-agent: OAI-SearchBot Disallow: /thmb/ User-agent: GPTBot Disallow: /thmb/ User-agent: news-please Disallow: / User-agent: anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Quora-Bot Disallow: / User-agent: omgilibot Disallow: / User-agent: omgili Disallow: / Sitemap: https://www.eatingwell.com/sitemap.xml Sitemap: https://www.eatingwell.com/google-news-sitemap.xml