Robots.txt for lonelyplanet.com

        User-agent: *
Disallow: /gateway/
Disallow: /thorntree/*
Disallow: /members/*
Disallow: /assets/
Disallow: /*?create_review=true*
Disallow: */v/vid/*?tag
Disallow: /*/articles/category/*
Disallow: *?type
Disallow: *?sort
Disallow: *?subtype
Disallow: *?neighborhoods
Disallow: */pa-act/
Disallow: */pa-tou/
Disallow: */poi-sho/
Disallow: */poi-ent/
Disallow: */poi-sle/
Disallow: */poi-dri/
Disallow: */poi-eat/
Disallow: */profile
Disallow: */trip-offer
Disallow: */hotels*
Disallow: */nightlife*
Disallow: */entertainment*
Disallow: */restaurants*
Disallow: */shopping*
Disallow: */attractions?page=*
Disallow: /api/*
Disallow: /search?*
Disallow: *searchResult?q
Disallow: *search?q
Disallow: *?utf8
Disallow: *?search
Disallow: *?&search
Disallow: *&search
Disallow: *?sort_dir
Disallow: *?sort_order
Disallow: *?filters
Disallow: *?ab_tours_cta
Disallow: *?authenticity_token
Disallow: *?ab_viator_activity_cta
Disallow: *?lpaffil
Disallow: *?category

Sitemap: https://www.lonelyplanet.com/sitemap.xml
Sitemap: https://www.lonelyplanet.com/sitemaps/articles/sitemap.xml
Sitemap: https://www.lonelyplanet.com/sitemaps/pois/attractions/sitemap.xml
Sitemap: https://www.lonelyplanet.com/sitemaps/destinations/sitemap.xml
Sitemap: https://www.lonelyplanet.com/sitemaps/google-news/sitemap.xml
Sitemap: https://www.lonelyplanet.com/video/smap.xml
Sitemap: https://www.lonelyplanet.com/articles/google-news
Sitemap: https://www.lonelyplanet.com/stories/sitemap-index.xml

User-agent: Sphere (www.sphere.com) scout*at*sphere*dot*com
Crawl-delay: 0.5

User-agent: BLEXBot
Crawl-delay: 10

User-agent: Blekkobot
Crawl-delay: 10

User-agent: 008
Disallow: /

User-agent: voltron
Disallow: /

User-agent: GPTBot
Disallow: /