User-agent: * #directed to all spiders Disallow: /manual Disallow: /cgi-bin/ Disallow: /ftp Disallow: /guestbook.html Disallow: /gbook Disallow: /sgraphics Disallow: /images Disallow: /apacheman Disallow: /imagesets Disallow: /mailform1.txt Disallow: /menu1.txt Disallow: /cgi-bin User-agent: Teleport Pro/1.28 Disallow: * User-agent: Teleport Pro/1.29 Disallow: *