# WWW robots exclusion file # see documentation at http://web.nexor.co.uk/mak/doc/robots/norobots.html User-agent: * Disallow: /pub # public ftp tree Disallow: /docs # various docs kept locally for faster access Disallow: /stats # server statistics Disallow: /cgi-bin # CGI-scripts directory Disallow: /Dienst Disallow: /~sizif/pcrouter Disallow: /sensors