Free tools
Robots.txt Examples
Robots.txt file content for unirioja.es.
Robot.txt file for: unirioja.es
User-agent: * Disallow: /avisos/* Disallow: /*ajaxCalendar=* Disallow: /actividades/20*-*-*/ Disallow: /open-source-and-social-responsability-osor/ Disallow: /productosor/* Disallow: /categoriaosor/*