Free tools
Robots.txt Examples
Robots.txt file content for momjunction.com.
Robot.txt file for: momjunction.com
User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /activity/ Disallow: /links-list/ Disallow: /links/ Disallow: /tools/ Disallow: /*ga.click.enc* Disallow: /baby-names/search/* Disallow: /search-results/ Disallow: /mj-admin-login/* Disallow: /wp-login.php* Disallow: /pn/* Disallow: /script_api/* Disallow: /trending/ Disallow: /collaboration/ Disallow: *.pdf Disallow: *.ttf Disallow: *.woff2 Disallow: *.js Disallow: */page/* Disallow: /feedback-form/* Disallow: /performance-test/* Allow: /baby-names/page/ User-agent: proximic Allow: / Allow: /* Sitemap: https://www.momjunction.com/sitemap_index.xml