Free tools
Robots.txt Examples
Robots.txt file content for capcut.com.
Robot.txt file for: capcut.com
User-agent: Baiduspider User-agent: 360Spider User-agent: Yisouspider User-agent: Sogouspider Disallow: / User-agent: Googlebot User-agent: Applebot User-agent: Bingbot User-agent: DuckDuckBot User-agent: Naverbot User-agent: Twitterbot User-agent: Yandex User-agent: Facebot User-agent: facebookexternalhit User-agent: facebookcatalog Allow: / Disallow: */discover/keyword/*/$ Disallow: */template-detail/*?*from_page=* Disallow: */template-detail/*?*from_page_click=* Disallow: /tools/desktop-video-editor-activity Disallow: /download-guidance Disallow: /tools/test-session-start-url Disallow: */resource/rtl-test-page$