Free tools

Robots.txt Examples

Robots.txt file content for frontiersin.org.

Robot.txt file for: frontiersin.org

      User-agent: *
Disallow: /images/
Disallow: /Images/
Disallow: /production/
Disallow: /Production/
Disallow: /review/
Disallow: /Review/
Disallow: /mail/
Disallow: /Mail/
Disallow: /admin/
Disallow: /Admin/
Disallow: /journals/testfieldhumanities/
Sitemap: https://www.frontiersin.org/sitemap.xml
Sitemap: https://kids.frontiersin.org/sitemap.xml
Sitemap: https://www.frontiersin.org/articles/sitemap-index.xml
Sitemap: https://coronavirus.frontiersin.org/sitemap.xml
Sitemap: https://www.frontiersin.org/sitemap-journals.xml
Sitemap: https://www.frontiersin.org/sitemap-home.xml
Sitemap: https://www.frontiersin.org/sitemap-article-pages-2022.xml
Sitemap: https://www.frontiersin.org/sitemap-magazines.xml
Sitemap: https://www.frontiersin.org/sitemap-science-news.xml
Sitemap: https://careers.frontiersin.org/sitemap.xml