Free tools

Robots.txt Examples

Robots.txt file content for mayoclinic.org.

Robot.txt file for: mayoclinic.org

      User-agent: *
Allow:  /

Disallow: /edu/
Disallow: /content/experience-fragments/*
Disallow: *.model.json
Disallow: /static/chunks/*
Disallow: /content/mayoclinic/*
Disallow: /api/*

sitemap: https://www.mayoclinic.org/arabic_condition_consolidated_concepts.xml
sitemap: https://www.mayoclinic.org/arabic_organization_concepts.xml
sitemap: https://www.mayoclinic.org/arabic_patient_consumer_faq.xml
sitemap: https://www.mayoclinic.org/arabic_patient_consumer_recipe.xml
sitemap: https://www.mayoclinic.org/arabic_patient_consumer_video.xml
sitemap: https://www.mayoclinic.org/arabic_patient_consumer_web.xml
sitemap: https://www.mayoclinic.org/arabic_procedure_concepts.xml
sitemap: https://www.mayoclinic.org/chinese_condition_consolidated_concepts.xml
sitemap: https://www.mayoclinic.org/chinese_organization_concepts.xml
sitemap: https://www.mayoclinic.org/chinese_patient_consumer_faq.xml
sitemap: https://www.mayoclinic.org/chinese_patient_consumer_recipe.xml
sitemap: https://www.mayoclinic.org/chinese_patient_consumer_video.xml
sitemap: https://www.mayoclinic.org/chinese_patient_consumer_web.xml
sitemap: https://www.mayoclinic.org/chinese_procedure_concepts.xml
sitemap: https://www.mayoclinic.org/condition_consolidated_concepts.xml
sitemap: https://www.mayoclinic.org/organization_concepts.xml
sitemap: https://www.mayoclinic.org/patient_consumer_biography.xml
sitemap: https://www.mayoclinic.org/patient_consumer_drug1.xml
sitemap: https://www.mayoclinic.org/patient_consumer_drug2.xml
sitemap: https://www.mayoclinic.org/patient_consumer_faq.xml
sitemap: https://www.mayoclinic.org/patient_consumer_recipe.xml
sitemap: https://www.mayoclinic.org/patient_consumer_video.xml
sitemap: https://www.mayoclinic.org/patient_consumer_web.xml
sitemap: https://www.mayoclinic.org/procedure_concepts.xml
sitemap: https://www.mayoclinic.org/spanish_condition_consolidated_concepts.xml
sitemap: https://www.mayoclinic.org/spanish_organization_concepts.xml
sitemap: https://www.mayoclinic.org/spanish_patient_consumer_faq.xml
sitemap: https://www.mayoclinic.org/spanish_patient_consumer_recipe.xml
sitemap: https://www.mayoclinic.org/spanish_patient_consumer_video.xml
sitemap: https://www.mayoclinic.org/spanish_patient_consumer_web.xml
sitemap: https://www.mayoclinic.org/spanish_procedure_concepts.xml