Free tools

Robots.txt Examples

Robots.txt file content for pitchbook.com.

Robot.txt file for: pitchbook.com

      User-agent: *
Sitemap: https://pitchbook.com/sitemap.xml

Disallow: /manage-subscriptions
Disallow: /manage-subscriptions/change-your-email-address
Disallow: /manage-subscriptions/change-your-email-address/thank-you
Disallow: /unsubscribe
Disallow: /profiles/search
Disallow: /news/search