Free tools
Robots.txt Examples
Robots.txt file content for fresherslive.com.
Robot.txt file for: fresherslive.com
User-agent: * Allow: / Disallow: /cgi-bin/ Disallow: /promotions/ Disallow: /android/ Disallow: /jobs/ Disallow: /govt-jobs-india/ User-agent: Googlebot Allow: / Disallow: /cgi-bin/ Disallow: /promotions/ Disallow: /android/ Disallow: /jobs/ Disallow: /govt-jobs-india/ Disallow: /*sarkari-results-details/ Disallow: /*rojgar-result-details/ User-agent: Googlebot-News Allow: / Disallow: /cgi-bin/ Disallow: /promotions/ Disallow: /android/ Disallow: /jobs/ Disallow: /govt-jobs-india/ Disallow: /*sarkari-results-details/ Disallow: /*rojgar-result-details/ User-agent: ChatGPT-User Disallow: / Sitemap: https://www.fresherslive.com/sitemap-index.xml Sitemap: https://www.fresherslive.com/sitemap-category.xml Sitemap: https://www.fresherslive.com/sitemap-recent-articles.xml Sitemap: https://www.fresherslive.com/google-news-sitemap.xml