Free tools
Robots.txt Examples
Robots.txt file content for msu.edu.
Robot.txt file for: msu.edu
<html> <head> <META NAME="robots" CONTENT="noindex,nofollow"> <script src="/_Incapsula_Resource?SWJIYLWA=5074a744e2e3d891814e9a2dace20bd4,719d34d31c8e3a6e6fffd425f7e032f3"> </script> <body> </body></html>