#/** #* robots.txt #* #* bot control for http://community.aon.at #* http://www.lionchat.at #* http://lionchat.at #* http://chat.aon.at #* http://lionchat.aon.at #* refer to 'Robots Exclusion Standard RFC4' #* the use of crawlers or other automated tests on this host is forbidden for #* any path defined by 'Disallow' directives. #* #* @package comm.meta #* @since 16.12.2002 #* @version $Id: $ #* @tabstop 8 #*/ # concerns any client application User-agent: * # no image indexing on assets Disallow: /skins/ # prevent the world from finding out the meaning of life Disallow: *.oliver # disallow weird piracy checks, worms & spiders Disallow: /MSADC/ Disallow: /MSOffice/ Disallow: /_vti_bin/ Disallow: /_mem_bin/ Disallow: /c/ Disallow: /d/ Disallow: /scripts/ Disallow: /%7e Disallow: %7e # special interest rules User-Agent: Googlebot-Image User-agent: Mediapartners-Google* User-agent: WebZIP User-agent: WebTrends Disallow: / # 'protect' possibly contained e-mail addresses User-agent: EmailCollector User-agent: EmailSiphon User-agent: EmailWolf User-agent: WebEMailExtrac.* User-agent: autoemailspider Disallow: / # community v2.x coded by CF, AH # additional work & tests by NE, MF, MG, HH, MM, DP