Free tools

Robots.txt Examples

Robots.txt file content for merdeka.com.

Robot.txt file for: merdeka.com

      User-Agent: GPTBot
Disallow: /

User-agent: *
Disallow: /webdev
Sitemap: https://www.merdeka.com/sitemap.xml
Disallow: */jelajah/
Disallow: */ucnews/