Free tools

Robots.txt Examples

Robots.txt file content for goodrx.com.

Robot.txt file for: goodrx.com

      # Hey there! You don't look like a robot...
#
# We'd love to hear from curious humans such as yourself.
#
# While you're poking around, why not check out our open positions at GoodRx?
#
# https://www.goodrx.com/jobs
#
# Or reach out directly via seo@goodrx.com
#
# If you are in fact a robot, pardon my presumptions. Here's what you came for:

User-agent: *
Disallow: /static
Disallow: /discount-card-sign-up
Disallow: /ajax
Disallow: /clear-location
Disallow: /change-location
Disallow: /reset-location
Disallow: /price-alert
Disallow: /coupon
Disallow: /doctors/price-guide
Disallow: /browse
Disallow: /my-rx
Disallow: /widget
Disallow: /mobile-api
Disallow: /iframe
Disallow: /blog/feed
Disallow: /compounded-drugs
Disallow: /compounded-drugs/*
Disallow: /esrx-mail-order
Disallow: /maintenance
Disallow: /discount-card/*
Disallow: /store
Disallow: /webview
Disallow: /auth0/*

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Omgilibot
Disallow: /

User-agent: Omgili
Disallow: /

User-agent: FacebookBot
Disallow: /

User-agent: Bytespider
Disallow: /

Sitemap: https://www.goodrx.com/sitemap.xml