Free tools
Robots.txt Examples
Robots.txt file content for yardbarker.com.
Robot.txt file for: yardbarker.com
User-agent: * Disallow: /players/* Disallow: /users/* Disallow: /forum/* Disallow: /account/* Disallow: /author/new/* Disallow: /quiz/embed/* Disallow: /quiz/results/* Disallow: /quiz/save_score/* Disallow: /asset/* Disallow: /widget/* Disallow: /articles/insert_inline_editor Disallow: /newsletter/popup_promo* Disallow: /content/grid_footer_feed* Disallow: /search/auto_complete* Disallow: /rss/* Sitemap: https://www.yardbarker.com/sitemap_news.xml Sitemap: https://www.yardbarker.com/sitemap/teams Sitemap: https://www.yardbarker.com/sitemap/players/1 Sitemap: https://www.yardbarker.com/sitemap/authors Sitemap: https://www.yardbarker.com/sitemap/sports Sitemap: https://www.yardbarker.com/sitemap/main