Free tools

Robots.txt Examples

Robots.txt file content for beebom.com.

Robot.txt file for: beebom.com

      User-agent: *
Sitemap: https://beebom.com/sitemap_index.xml

Sitemap: https://beebom.com/news-sitemap.xml



Disallow: /wp-admin/

Disallow: /wp-login.php

Disallow: /*?s

Disallow: /search/*

Disallow: /wp-comments-posts.php

Disallow: /pwa-home-page/*

Disallow: /career/*

Disallow: /glossary/*

Disallow:  /wp-content/plugins/beebom-features/assets/*

Disallow: /wp-content/themes/beebom-2023/assets/*

Allow: /wp-content/plugins/amp/assets/images/search_blue.svg

Allow: /wp-content/plugins/tablepress/css/default.min.css