Free tools

Robots.txt Examples

Robots.txt file content for studysmarter.co.uk.

Robot.txt file for: studysmarter.co.uk

      User-agent: *
Disallow: /wp-admin/
Disallow: /*?wordfence
Allow: /wp-admin/admin-ajax.php

User-agent: SemrushBot
Disallow: /

User-agent: deepcrawl
Disallow: /

User-agent: audisto-essential
Disallow: /

User-agent: audisto
Disallow: /

User-agent: zyklop
Disallow: /

Sitemap: https://www.studysmarter.co.uk/pro-sitemaps-4258727.php