Free tools
Robots.txt Examples
Robots.txt file content for khanacademy.org.
Robot.txt file for: khanacademy.org
User-agent: GPTBot Disallow: / User-agent: * Sitemap: https://www.khanacademy.org/sitemap.xml Disallow: /_ah/ Disallow: /admin/ Disallow: /api/internal/_bb/ Disallow: /crash Disallow: /devadmin/ Disallow: /embed_video Disallow: /login?continue=* Disallow: /postlogin Disallow: /preview/ Disallow: /search Disallow: /searchtest Disallow: /settings/linkaccount Disallow: /khan-labs?step=terms-and-conditions Disallow: /khan-labs?step=terms-and-conditions-redirect Disallow: /khan-labs?step=no-birthdate Disallow: /khan-labs?step=under-age-gate Disallow: /khan-labs?step=english-only Disallow: /khan-labs?step=us-only Disallow: /khan-labs?step=children-over-limit Disallow: /khan-labs?step=ineligible Disallow: /khanmigo/checkout?step=terms-and-conditions Disallow: /khanmigo/checkout?step=terms-and-conditions-redirect Disallow: /khanmigo/checkout?step=no-birthdate Disallow: /khanmigo/checkout?step=under-age-gate Disallow: /khanmigo/checkout?step=english-only Disallow: /khanmigo/checkout?step=us-only Disallow: /khanmigo/checkout?step=children-over-limit Disallow: /khanmigo/checkout?step=ineligible Disallow: *?qa_expand_key*