Free tools

Robots.txt Examples

Robots.txt file content for wionews.com.

Robot.txt file for: wionews.com

      User-agent: *
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: PetalBot
Disallow: /

User-agent: Cliqzbot
Disallow: /

Sitemap: https://www.wionews.com/googlenews.xml
Sitemap: https://www.wionews.com/sitemap-index.xml
Sitemap: https://www.wionews.com/complete-videos-sitemap.xml
Sitemap: https://www.wionews.com/image-sitemap.xml