################################################################################ # exclude from robots # exclude AltaVista to go to the "worm" /telesc.html/coude/........The problem # should be fixed after an email from AltaVista on 09.09.2001 # User-agent: AltaVista # Disallow: /telesc.html/coude/ # Ziener: 03/2002 ################################################################################ # exclude special directories User-agent: * Disallow: /manual/ Disallow: /cdb/ Disallow: /gif/ Disallow: /old/ Disallow: /internal/ Disallow: /usage/ # but allow htdig to index our doc-tree User-agent: susedig Disallow: