#This is a file retrieved by webwalkers a.k.a. spiders that #conform to a defacto standard. # See <URL:http://info.webcrawler.com/mak/projects/robots/robots.html> # #Format is: # User-agent: <name of spider> # Disallow: <nothing> | <path> # Allow: <nothing> | <path> #------------------------------------------------------------------------- User-Agent: * Disallow: /documents Disallow: /flash_main Disallow: /include Disallow: /pics_main