Free tools

Robots.txt Examples

Robots.txt file content for healthdirect.gov.au.

Robot.txt file for: healthdirect.gov.au

      #
# robots.txt
#
User-agent: *
Disallow: /medicines/___service
Disallow: /australian-health-services/___results
Disallow: /reference/item/
Disallow: /organisation/
Disallow: /service/
Disallow: /scccc19
Disallow: /national-covid-19-helpline-faqs
Disallow: /covid19-services

Sitemap: https://www.healthdirect.gov.au/sitemap.xml
Sitemap: https://www.healthdirect.gov.au/australian-health-services/sitemaps/sitemap-index-health-services.xml