Free tools

Robots.txt Examples

Robots.txt file content for momjunction.com.

Robot.txt file for: momjunction.com

      User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /activity/
Disallow: /links-list/
Disallow: /links/
Disallow: /tools/
Disallow: /*ga.click.enc*
Disallow: /baby-names/search/*
Disallow: /search-results/
Disallow: /mj-admin-login/*
Disallow: /wp-login.php*
Disallow: /pn/*
Disallow: /script_api/*
Disallow: /trending/
Disallow: /collaboration/
Disallow: *.pdf
Disallow: *.ttf
Disallow: *.woff2
Disallow: *.js
Disallow: */page/*
Disallow: /feedback-form/*
Disallow: /performance-test/*

Allow: /baby-names/page/

User-agent: proximic
Allow: /

Allow: /*
Sitemap: https://www.momjunction.com/sitemap_index.xml