# General Site Disallows User-agent: * Disallow: /_private/ Disallow: /_vti_log/ Disallow: /cgi-bin/ Disallow: /confirmation_error/ Disallow: /database/ Disallow: /downloads/ Disallow: /form_results/ Disallow: /header_footer/ Disallow: /images/ Disallow: /java/ Disallow: /logs/ Disallow: /mail_list/ Disallow: /reference/ Disallow: /secure/ Disallow: /stats/ Disallow: /inc/ # EmailSiphon is a hunter/gatherer which extracts email addresses for spam-mailers to use User-agent: EmailSiphon Disallow: /