Free tools

Robots.txt Examples

Robots.txt file content for howtopronounce.com.

Robot.txt file for: howtopronounce.com

      User-agent: ltx71
Disallow: /

User-agent: GPTBot
Disallow: /search

User-agent: GPTBot
Disallow: /search-data

User-agent: Bingbot
Disallow: /search

User-agent: Bingbot
Disallow: /search-data

User-agent: Quantcastbot
Disallow: /search

User-agent: Quantcastbot
Disallow: /search-data

User-agent: weborama-fetcher
Disallow: /search

User-agent: weborama-fetcher
Disallow: /search-data

User-agent: DotBot
Disallow: /search

User-agent: DotBot
Disallow: /search-data

User-agent: ias-va
Disallow: /search

User-agent: ias-va
Disallow: /search-data

User-agent: ias-ie
Disallow: /search

User-agent: ias-ie
Disallow: /search-data

User-Agent: *
Disallow:
Allow: /