Free tools
Robots.txt Examples
Robots.txt file content for booked.net.
Robot.txt file for: booked.net
User-Agent: * Allow: / Disallow: /reviewpage/ Disallow: /ajax/ Disallow: /?page=stat Disallow: /?page=hotel_ajax Disallow: /?page=hotellist_json Disallow: /reviewpage2/ Sitemap: https://www.booked.net/data/sitemaps/index.xml