Free tools

Robots.txt Examples

Robots.txt file content for wordnik.com.

Robot.txt file for: wordnik.com

      User-agent: *
Allow: /
Disallow: /fragments/twitter
Sitemap: http://sitemaps.wordnik.com/wordnikSitemapIndex.xml