# robots.txt for http://www.reter.com/ User-agent: MOMspider # The Multi-Owner Maintenance Spider Disallow: /cgi-bin/ # Script files #User-agent: UltraseekNIEHS # Allows our own Ultraseek Server in #Disallow: # Free reign User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /restricted/ User-agent: MOMspider/1.00 # From: 204.71.249.80 Disallow: / # For more information on using and configuring the robots.txt file # Go to http://info.webcrawler.com/mak/projects/robots/norobots.html