# # This is an empty robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed. # # Following page has details on how to setup a robots.txt file and # related security issues: # # http://www.chami.com/tips/internet/010198I.html # # 1. Uncomment following two lines by removing "#" at the beginning to # indicate that all robots should stay away from the /cgi-bin/ folder User-agent: * Disallow: /cgi-bin/ Disallow: /thebaby/ Disallow: /music/ Disallow: /games/ Disallow: /anfycounter/ Disallow: /htsdata/ Disallow: /history/ Disallow: /archived txt files/ Disallow: /counter/ Disallow: /for_later_use/ Disallow: /wwwboard/ Disallow: /starterlog/ Disallow: /logs/ Disallow: /temp/ Disallow: /ftp/ Disallow: /butts/ Disallow: /images/ Disallow: /For You Rick_files/ Disallow: /counters/ Disallow: /digits/ Disallow: /FOIA_Laws/ Disallow: /IAQ/ Disallow: /javascript-fx/ Disallow: /LIL/ Disallow: /look_at_us_files/ Disallow: /maint/ Disallow: /swf/ Disallow: /things_that_make_you_go_hmmm_files/ Disallow: /wmv/ # 2. Following two lines indicate that robots named "WWW_Robot_Name" # should stay away from this site. User-agent: "mms dash mmcrawler dash support at yahoo dash inc dot com" User-agent: "mms-mmcrawler-support@yahoo-inc.com" Disallow: / # 3. Following two lines indicate that robots named "WWW_Wanderer_Name" # should not index files in the /private/ folder. #User-agent: WWW_Wanderer_Name #Disallow: /private/