# Major Search Engines and Known Friendly Spiders (allowed) User-agent: Googlebot Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: Teoma Disallow: User-agent: Gigabot Disallow: User-agent: Scrubby Disallow: User-agent: Robozilla Disallow: # Everyone Else (NOT allowed) User-agent: Googlebot-Image Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.png$ Disallow: /*.JPG$ Disallow: /*.GIF$ Disallow: /*.PDF$ Disallow: /*.jpeg$ Disallow: /*.exe$ User-agent: * Disallow: /_private/ Disallow: /_vti_bin/ Disallow: /_vti_cnf/ Disallow: /_vti_log/ Disallow: /_vti_pvt/ Disallow: /_vti_txt/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /media/ Disallow: /blog/cgi-bin/ Disallow: /blog/images/ Disallow: /blog/interface/ Disallow: /blog/js/ Disallow: /blog/languages/ Disallow: /blog/mp3/ Disallow: /blog/player/ Disallow: /blog/scripts/ Disallow: /blog/themes/