Free tools

Robots.txt Examples

Robots.txt file content for amazon.com.br.

Robot.txt file for: amazon.com.br

      User-agent: *
Allow: /*/dp/
Allow: /gp/adlp/
Allow: /gp/aw/kindle/first
Allow: /gp/aw/mom/signup
Allow: /gp/aw/ybh
Allow: /gp/baby-reg
Allow: /gp/cobrandcard/marketing.html
Allow: /gp/coins/earn
Allow: /gp/communication-manager/inbox.html
Allow: /gp/css/gc/payment/redeem-gc-balance
Allow: /gp/css/homepage.html
Allow: /gp/css/order-history
Allow: /gp/digital/ep-landing-page
Allow: /gp/digital/fiona/kcp-landing-page
Allow: /gp/drive/app-download
Allow: /gp/goldbox
Allow: /gp/help
Allow: /gp/history
Allow: /gp/mom/signup
Allow: /gp/prime/pipeline/prime_gifting_landing
Allow: /gp/product/
Allow: /gp/sign-in.html
Allow: /gp/tradein/your-account
Allow: /gp/video/library
Allow: /gp/video/watchlist
Allow: /gp/vine/help
Allow: /help/kindlecloudreader
Allow: /help/kindlefire
Allow: /iss/credit/rewardscardmember
Allow: /iss/credit/storecardmember
Allow: /kindlefirst
Allow: /kindlepersonaldocuments
Allow: /manageyourkindle
Allow: /mn/dcw/myx.html
Allow: /mytv
Allow: /oc/dash-button
Allow: /returns
Allow: /robots.txt
Allow: /s/
Allow: /s?
Allow: /*/s/
Allow: /*/s?
Allow: /sitemaps
Allow: /storecard
Allow: /gp/aw/d/
Allow: /your-account
Allow: /your-orders
Disallow: /gp/help/reports/infringement/jquery/handle-notice-submit.html
Disallow: /gp/help/customer/handler/handle-email-submit.html
Disallow: /gp/ask-widget/askWidget
Disallow: /gp/cart 
Disallow: /gp/flex 
Disallow: /gp/product/e-mail-friend 
Disallow: /gp/product/product-availability 
Disallow: /gp/product/rate-this-item
Disallow: /ss/customer-reviews/lighthouse/
Disallow: /hz/leaderboard/top-reviewers/
Disallow: /hz/leaderboard/hall-of-fame/
Disallow: /review/top-reviewers/
Disallow: /review/top-reviewers
Disallow: /review/hall-of-fame
Disallow: /reviews/top-reviewers/
Disallow: /reviews/top-reviewers
Disallow: /reviews/hall-of-fame
Disallow: /hz/help/contact/*/message/$
Disallow: /-/
Disallow: /gp/aw/shoppingAids/
Disallow: /hz/contact-us/ajax/initiate-trusted-contact/

User-agent: EtaoSpider
Disallow: /

User-agent: GPTBot
Disallow: /

User-agent: CCBot
Disallow: /