Robots.txt for investing.com
User-agent: * Disallow: /registration Disallow: /login Disallow: /images Disallow: /admin Disallow: /content Disallow: /common Disallow: /charts_xml Disallow: /index.php Disallow: /unsubscribe Disallow: /toolbar Disallow: /webmaster-tools/verify Disallow: /upload_images Disallow: /jp.php Disallow: /charts/advinion.php Disallow: /signup Disallow: /studios/financialounge Disallow: /members Disallow: /mobile/mobile-redirect Disallow: /mobile/footer-redirect Disallow: /research/ Disallow: /brokers2/ Disallow: /cdn-cgi/ Disallow: /brokers/house/guest/* Allow: /members/contributors Allow: /research/$ Disallow: /pro/ Allow: /pro/$ Allow: /pro/assets/ Allow: /pro/ideas$ Allow: /pro/ideas/* Allow: /pro/*/explorer$ Allow: /pro/*/explorer/marketcap$ Allow: /pro/*/explorer/marketcap_adj$ Allow: /pro/*/explorer/volume_avg_3m$ Allow: /pro/*/explorer/asset_price_return_1y$ Allow: /pro/*/explorer/shares_out$ Allow: /pro/*/explorer/total_rev$ Allow: /pro/*/explorer/ni_avail_excl$ Allow: /pro/*/explorer/eps_basic_cont$ Allow: /pro/*/explorer/pe_ltm$ Allow: /pro/*/explorer/roa$ Allow: /pro/*/explorer/roe$ Allow: /pro/*/explorer/gp_margin$ Allow: /pro/*/explorer/price_to_book$ Allow: /pro/*/explorer/beta$ Allow: /pro/screener Allow: /pro/propicks$ Allow: /pro/propicks/* Allow: /pro/*/compare$ Allow: /pro/*/compare/* Disallow: /news/pro/ Allow: /news/pro/$ Disallow: /news/assorted/ Allow: /news/assorted/$ Disallow: /news/press-releases/ Allow: /news/press-releases/$ User-agent: Mediapartners-Google Disallow: User-agent: grapeshot Disallow: User-agent: proximic Disallow: