Free tools
Robots.txt Examples
Robots.txt file content for healthdirect.gov.au.
Robot.txt file for: healthdirect.gov.au
# # robots.txt # User-agent: * Disallow: /medicines/___service Disallow: /australian-health-services/___results Disallow: /reference/item/ Disallow: /organisation/ Disallow: /service/ Disallow: /scccc19 Disallow: /national-covid-19-helpline-faqs Disallow: /covid19-services Sitemap: https://www.healthdirect.gov.au/sitemap.xml Sitemap: https://www.healthdirect.gov.au/australian-health-services/sitemaps/sitemap-index-health-services.xml