Free tools

Robots.txt Examples

Robots.txt file content for reserving.com.

Robot.txt file for: reserving.com

      User-agent: *
Disallow: /*comentariosajax
Disallow: /*comentariosAjax
Disallow: /*getReviews
Disallow: /rewrite/
Disallow: /apps/comentarios/
Disallow: /fichs/N/busqueda.php
Disallow: /busquedaDisp/
Disallow: /cgi-bin/
Disallow: /cdn-cgi/
Disallow: /qos/
Disallow: /kml/
Disallow: /blog*
Disallow: /hotel/page.cgi*
Disallow: /hotelComentarios*
Disallow: /mejores/valorados.php*
Disallow: */Array$
Disallow: /apartments
Disallow: /search/

Allow: /

User-agent: sistrix
User-agent: rogerbot
User-agent: MJ12bot
User-agent: SemrushBot-SA
User-agent: SemrushBot
User-agent: BUbiNG
Disallow: /