Free tools

Robots.txt Examples

Robots.txt file content for khanacademy.org.

Robot.txt file for: khanacademy.org

      User-agent: GPTBot
Disallow: /

User-agent: *
Sitemap: https://www.khanacademy.org/sitemap.xml
Disallow: /_ah/
Disallow: /admin/
Disallow: /api/internal/_bb/
Disallow: /crash
Disallow: /devadmin/
Disallow: /embed_video
Disallow: /login?continue=*
Disallow: /postlogin
Disallow: /preview/
Disallow: /search
Disallow: /searchtest
Disallow: /settings/linkaccount
Disallow: /khan-labs?step=terms-and-conditions
Disallow: /khan-labs?step=terms-and-conditions-redirect
Disallow: /khan-labs?step=no-birthdate
Disallow: /khan-labs?step=under-age-gate
Disallow: /khan-labs?step=english-only
Disallow: /khan-labs?step=us-only
Disallow: /khan-labs?step=children-over-limit
Disallow: /khan-labs?step=ineligible
Disallow: /khanmigo/checkout?step=terms-and-conditions
Disallow: /khanmigo/checkout?step=terms-and-conditions-redirect
Disallow: /khanmigo/checkout?step=no-birthdate
Disallow: /khanmigo/checkout?step=under-age-gate
Disallow: /khanmigo/checkout?step=english-only
Disallow: /khanmigo/checkout?step=us-only
Disallow: /khanmigo/checkout?step=children-over-limit
Disallow: /khanmigo/checkout?step=ineligible
Disallow: *?qa_expand_key*