Free tools
Robots.txt Examples
Robots.txt file content for goodrx.com.
Robot.txt file for: goodrx.com
# Hey there! You don't look like a robot... # # We'd love to hear from curious humans such as yourself. # # While you're poking around, why not check out our open positions at GoodRx? # # https://www.goodrx.com/jobs # # Or reach out directly via seo@goodrx.com # # If you are in fact a robot, pardon my presumptions. Here's what you came for: User-agent: * Disallow: /static Disallow: /discount-card-sign-up Disallow: /ajax Disallow: /clear-location Disallow: /change-location Disallow: /reset-location Disallow: /price-alert Disallow: /coupon Disallow: /doctors/price-guide Disallow: /browse Disallow: /my-rx Disallow: /widget Disallow: /mobile-api Disallow: /iframe Disallow: /blog/feed Disallow: /compounded-drugs Disallow: /compounded-drugs/* Disallow: /esrx-mail-order Disallow: /maintenance Disallow: /discount-card/* Disallow: /store Disallow: /webview Disallow: /auth0/* Disallow: /good-data/* Disallow: /*?_pxhc=* Disallow: /optimizely-edge/* User-agent: TagInspector Allow: / User-agent: GPTBot Allow: /*form=* Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Omgilibot Disallow: / User-agent: Omgili Disallow: / User-agent: FacebookBot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://www.goodrx.com/sitemap.xml