Robots.txt for dbpedia.org

        User-agent: *
Crawl-delay: 10
Disallow: /admin
Disallow: /DeepZoomCache
Disallow: /eNews
Disallow: /fct
Disallow: /forums
Disallow: /HtmlPivotViewer
Disallow: /IBuySpy
Disallow: /jdbcdemo
Disallow: /PortalCS
Disallow: /tutorial
Disallow: /webapp
Disallow: /xqdemo
Disallow: /xslt