Konigle

Robots.txt examples

See examples of robots.txt files. You can copy and use it on your website.

#1

Robots.txt for 11880.com

#2

Robots.txt for 123rf.com

#3

Robots.txt for 20minutes.fr

#4

Robots.txt for 20minutos.es

#5

Robots.txt for aaa.com

#6

Robots.txt for aa.com.tr

#7

Robots.txt for aafp.org

#8

Robots.txt for aajtak.in

#9

Robots.txt for aarp.org

#10

Robots.txt for abc.es

#11

Robots.txt for abc.net.au

#12

Robots.txt for abebooks.com

#13

Robots.txt for abplive.com

#14

Robots.txt for abril.com.br

#15

Robots.txt for academia.edu

#16

#17

Robots.txt for accuweather.com

#18

Robots.txt for acs.org

#19

Robots.txt for actu.fr

#20

Robots.txt for adobe.com

#21

Robots.txt for agoda.com

#22

Robots.txt for airbnb.com

#23

Robots.txt for alamy.com

#24

Robots.txt for alamy.es

#25

Robots.txt for alberta.ca

#26

Robots.txt for alibaba.com

#27

Robots.txt for aliexpress.com

#28

Robots.txt for aljazeera.com

#29

Robots.txt for allegro.pl

#30

Robots.txt for allevents.in

#31

Robots.txt for allmusic.com

#32

Robots.txt for allocine.fr

#33

Robots.txt for allrecipes.com

#34

Robots.txt for alltrails.com

#35

Robots.txt for allure.com

#36

Robots.txt for almaany.com

#37

Robots.txt for amarujala.com

#38

Robots.txt for amazon.ca

#39

Robots.txt for amazon.co.jp

#40

Robots.txt for amazon.com

#41

Robots.txt for amazon.com.au

#42

Robots.txt for amazon.com.br

#43

Robots.txt for amazon.com.mx

#44

Robots.txt for amazon.co.uk

#45

Robots.txt for amazon.de

#46

Robots.txt for amazon.es

#47

Robots.txt for amazon.fr

#48

Robots.txt for amazon.in

#49

Robots.txt for amazon.it

#50

Robots.txt for ameblo.jp