Free tools

Robots.txt Examples

Robots.txt file content for sportingnews.com.

Robot.txt file for: sportingnews.com

      User-agent: *
Disallow: /api
Disallow: /api/url
Disallow: /api/url/article?uuid=*
Disallow: /px/
Disallow: /user
Disallow: /user/
Disallow: /service
Disallow: /service/
Disallow: /test/
Disallow: /nba-service/
Disallow: /module/nba-live-test
Disallow: /fantasy/player-updates?page=*
Disallow: /?page=*
Sitemap: https://www.sportingnews.com/ar/sitemap.xml
Sitemap: https://www.sportingnews.com/au/sitemap.xml
Sitemap: https://www.sportingnews.com/br/sitemap.xml
Sitemap: https://www.sportingnews.com/ca/sitemap.xml
Sitemap: https://www.sportingnews.com/es/sitemap.xml
Sitemap: https://www.sportingnews.com/in/sitemap.xml
Sitemap: https://www.sportingnews.com/jp/sitemap.xml
Sitemap: https://www.sportingnews.com/kr/sitemap.xml
Sitemap: https://www.sportingnews.com/mx/sitemap.xml
Sitemap: https://www.sportingnews.com/th/sitemap.xml
Sitemap: https://www.sportingnews.com/uk/sitemap.xml
Sitemap: https://www.sportingnews.com/us/sitemap.xml
Sitemap: https://www.sportingnews.com/us-es/sitemap.xml
Sitemap: https://www.sportingnews.com/vn/sitemap.xml
Sitemap: https://www.sportingnews.com/ar/news-sitemap.xml
Sitemap: https://www.sportingnews.com/au/news-sitemap.xml
Sitemap: https://www.sportingnews.com/br/news-sitemap.xml
Sitemap: https://www.sportingnews.com/ca/news-sitemap.xml
Sitemap: https://www.sportingnews.com/es/news-sitemap.xml
Sitemap: https://www.sportingnews.com/in/news-sitemap.xml
Sitemap: https://www.sportingnews.com/jp/news-sitemap.xml
Sitemap: https://www.sportingnews.com/kr/news-sitemap.xml
Sitemap: https://www.sportingnews.com/mx/news-sitemap.xml
Sitemap: https://www.sportingnews.com/th/news-sitemap.xml
Sitemap: https://www.sportingnews.com/uk/news-sitemap.xml
Sitemap: https://www.sportingnews.com/us/news-sitemap.xml
Sitemap: https://www.sportingnews.com/us-es/news-sitemap.xml
Sitemap: https://www.sportingnews.com/vn/news-sitemap.xml