Free tools
Robots.txt Examples
Robots.txt file content for collegedunia.com.
Robot.txt file for: collegedunia.com
User-agent: * Disallow: /lp/ #Disallow LP pages Disallow: /public/lp/ #Disallow LP pages Disallow: /auth/reset-password/ #Disallow Auth pages Disallow: /auth/ #Disallow from Auth Pages Disallow: /public/blog/* #Disallow Blog from getting Indexed Disallow: /college/get-course-popup-data* Disallow: /common-application-form Disallow: /caf-college/* #caf college pages Disallow: /profile/* #profile pages #Disallow: /*?ajax=1 Disallow: /ajax-header/ Disallow: /get-images #URL parameters blocking for SEO Disallow: /*?preview= Disallow: /*&preview= Disallow: /*?course_type= Disallow: /*&course_type= Disallow: /*?exam_id= Disallow: /*&exam_id= Disallow: /*?duration= Disallow: /*&duration= Disallow: /*?type_of_college= Disallow: /*&type_of_college= Disallow: /*?course_duration= Disallow: /*&course_duration= Disallow: /*?unv= Disallow: /*&unv= Disallow: /*?approve_by= Disallow: /*&approve_by= Disallow: /*?fee_range= Disallow: /*&fee_range= Disallow: /*?query= Disallow: /*&query= Disallow: /*?sub_stream_id= Disallow: /*&sub_stream_id= Disallow: /*?uredis= Disallow: /*&uredis= Disallow: /*?university_id= Disallow: /*&university_id= Disallow: /*?course_id= Disallow: /*&course_id= Disallow: /*?slug= Disallow: /*&slug= Disallow: /*?exam= Disallow: /*&exam= Disallow: /*?category= Disallow: /*&category= Disallow: /*?state_id= Disallow: /*&state_id= Disallow: /*?fees= Disallow: /*&fees= Disallow: /*&page= Disallow: /*?city_id= Disallow: /*&city_id= Disallow: /*?category= Disallow: /*&category= Disallow: /*?approved_by= Disallow: /*&approved_by= Disallow: /*?c= Disallow: /*&c= Disallow: /*?popup= Disallow: /*&popup= Disallow: /*?ref= Disallow: /*?head_one= Disallow: /*&head_one= Disallow: /*?stream= Disallow: /*&stream= Disallow: /*?state= Disallow: /*&state= Disallow: /*?tag_ids= Disallow: /*&tag_ids= Disallow: /*?category_ids= Disallow: /*&category_ids= Disallow: /*?course_levels= Disallow: /*&course_levels= Disallow: /*?city_ids Disallow: /*&city_ids== Disallow: /*?course_types= Disallow: /*&course_types= Disallow: /*?has_scholarship= Disallow: /*&has_scholarship= Disallow: /*?coursetag= Disallow: /*&coursetag= Disallow: /*?substream= Disallow: /*&substream= Disallow: /*?tag= Disallow: /*&tag= Disallow: /*?college= Disallow: /*&college= Disallow: /*&page= Disallow: /*?page= Disallow: /*?course_tag_id= Disallow: /*&course_tag_id= Disallow: /*?course_year= Disallow: /*&course_year= Disallow: /*?slug_id= Disallow: /*&slug_id= Disallow: /*?ranking_agency_id= Disallow: /*&ranking_agency_id= Disallow: /*?course_slug= Disallow: /*&course_slug= Disallow: /*?courseTag= Disallow: /*&courseTag= #for question listing Disallow: /*?topicIds= Disallow: /*?chapterIds= Disallow: /*?year= Disallow: /*?examIds= Disallow: /*?bookIds= Disallow: /*?subjectIds= Disallow: /*&topicIds= Disallow: /*&chapterIds= Disallow: /*&year= Disallow: /*&examIds= Disallow: /*&bookIds= Disallow: /*&subjectIds= Sitemap: https://collegedunia.com/sitemap-news-updates.xml Sitemap: https://collegedunia.com/sitemap-updates.xml Sitemap: https://collegedunia.com/sitemap-index-updates.xml