Free tools

Robots.txt Examples

Robots.txt file content for apkcombo.com.

Robot.txt file for: apkcombo.com

      Sitemap: https://apkcombo.com/sitemap.xml
User-agent: *
Disallow: */similar/$
Disallow: */similar$
Disallow: /d?u=*
Disallow: /r2?u=*
Disallow: */dl?token=*
Disallow: */dl/?token=*
Disallow: */download/*-zip$
Disallow: */download/*-zip/$
Disallow: */download/*-apk$
Disallow: */download/*-apk/$
Disallow:/developer/*
Disallow:/*/developer/*
Disallow:/apk-downloader/?q=*
Disallow:/*/apk-downloader/?q=*
Disallow:/screenshots?p=*
Disallow:/screenshots/?p=*
Disallow:*/countries$
Disallow:*/countries/$
Disallow:/report$
Disallow:*/report$
Disallow:/report?*
Disallow:*/report?*
Disallow:/report/$
Disallow:*/report/$
Disallow:/report/?*
Disallow:*/report/?*
Disallow:/checkin/
Disallow:/api/apks_queue/*

User-agent: *
Allow: /ads.txt

User-agent: Mediapartners-Google
Allow: /
User-agent: Sogou web spider
Disallow:/
User-agent: weborama-fetcher
Disallow:/
User-agent: rogerbot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: AddThis.com (http://support.addthis.com/)
Disallow: /
User-agent: weborama-fetcher
Disallow: /
User-agent: proximic
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: Proximic
Disallow:/
User-agent: BLEXBot
Disallow:/
User-agent: SEOkicks
Disallow:/
User-agent: CriteoBot
Disallow:/
User-agent: SemrushBot
Disallow:/
User-agent: Applebot
Disallow: /
User-agent: DataForSeoBot
Disallow: /
User-agent: MJ12bot
Disallow: /