Free tools

Robots.txt Examples

Robots.txt file content for booked.net.

Robot.txt file for: booked.net

      User-Agent: *
Allow: /
Disallow: /reviewpage/
Disallow: /ajax/
Disallow: /?page=stat
Disallow: /?page=hotel_ajax
Disallow: /?page=hotellist_json
Disallow: /reviewpage2/

Sitemap: https://www.booked.net/data/sitemaps/index.xml