Free tools

Robots.txt Examples

Robots.txt file content for fresherslive.com.

Robot.txt file for: fresherslive.com

      User-agent: *
Allow: /
Disallow: /cgi-bin/
Disallow: /promotions/
Disallow: /android/
Disallow: /jobs/
Disallow: /govt-jobs-india/

User-agent: Googlebot
Allow: /
Disallow: /cgi-bin/
Disallow: /promotions/
Disallow: /android/
Disallow: /jobs/
Disallow: /govt-jobs-india/
Disallow: /*sarkari-results-details/
Disallow: /*rojgar-result-details/

User-agent: Googlebot-News
Allow: /
Disallow: /cgi-bin/
Disallow: /promotions/
Disallow: /android/
Disallow: /jobs/
Disallow: /govt-jobs-india/
Disallow: /*sarkari-results-details/
Disallow: /*rojgar-result-details/

User-agent: ChatGPT-User
Disallow: /

Sitemap: https://www.fresherslive.com/sitemap-index.xml
Sitemap: https://www.fresherslive.com/sitemap-category.xml
Sitemap: https://www.fresherslive.com/sitemap-recent-articles.xml
Sitemap: https://www.fresherslive.com/google-news-sitemap.xml