Free tools

Robots.txt Examples

Robots.txt file content for capcut.com.

Robot.txt file for: capcut.com

      User-agent: Baiduspider
User-agent: 360Spider
User-agent: Yisouspider
User-agent: Sogouspider
Disallow: /

User-agent: Googlebot
User-agent: Applebot
User-agent: Bingbot
User-agent: DuckDuckBot
User-agent: Naverbot
User-agent: Twitterbot
User-agent: Yandex
User-agent: Facebot
User-agent: facebookexternalhit
User-agent: facebookcatalog
Allow: /

Disallow: */discover/keyword/*/$
Disallow: */template-detail/*?*from_page=*
Disallow: */template-detail/*?*from_page_click=*
Disallow: /tools/desktop-video-editor-activity
Disallow: /download-guidance
Disallow: /tools/test-session-start-url
Disallow: */resource/rtl-test-page$