Free tools

Robots.txt Examples

Robots.txt file content for unirioja.es.

Robot.txt file for: unirioja.es

      User-agent: *
Disallow: /avisos/*
Disallow: /*ajaxCalendar=*
Disallow: /actividades/20*-*-*/
Disallow: /open-source-and-social-responsability-osor/
Disallow: /productosor/*
Disallow: /categoriaosor/*