# Note: This is the global SoGE robots exclusion file and is aliased onto # all virtual hosts. http://www.robotstxt.org/wc/exclusion-admin.html # If you wish to exclude robots from specific # resources on a site make use of the robots META tag instead. # See: http://www.robotstxt.org/wc/meta-user.html # Currently set to allow all robots full access to everything except # the following specified directories (Chris 01/10/08) User-agent: * Disallow: /intranet/ Disallow: /cgi-bin/ Disallow: /shared/ Disallow: /~glclark/msc/