# 2000/04/17 Sylvain Robitaille: Robots Exclusion file for Newsflash
# ----------
#
# Some web search engines are indexing web pages that shouldn't be
# indexed. We can have them exclude certain portions of our server.
#
# Note that this file contains one line for each part of the web server
# that is to be excluded from web indexes. Regular expressions are not
# recorgnized. Blank lines within a record are not permitted, as these
# are used to delimit multiple records.
#
# See http://info.webcrawler.com/mak/projects/robots/exclusion.html
# for a complete description of this file.

# All search engines:
User-agent: *
#
# The newsgroups Monster List:
Disallow: /public/misc/newsgroups
#
# The clariweb groups:
Disallow: /clariweb/
#
# The hyperactive list of groups:
Disallow: /netnews/
#
# Support files:
Disallow: /indices/
Disallow: /style/
Disallow: /cgi-bin/
Disallow: /icons/