Free tools
Robots.txt Examples
Robots.txt file content for spotify.com.
Robot.txt file for: spotify.com
User-agent: * Disallow: /*/about-us/contact/contact-spotify-password/ Disallow: /*/about-us/contact/contact-spotify-account/ Disallow: /*/get-spotify/* Disallow: /*/xhr/* Disallow: /*/external/* Disallow: /*/legal/*?ets= Disallow: /*/legal/advertiser-terms-and-conditions/ Disallow: /*/account/cls/* Disallow: /*/starbuckspartners Disallow: /starbuckspartners Sitemap: https://www.spotify.com/sitemap.xml