Free tools

Robots.txt Examples

Robots.txt file content for lumenlearning.com.

Robot.txt file for: lumenlearning.com

      # Default robots file version:2
User-agent: *
Disallow: /calendar/action*
Disallow: /events/action*
Allow: /*.css
Allow: /*.js
Disallow: /*?
Crawl-delay: 3