User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /_private/ Disallow: /Chat/ Disallow: /Templates/ # You need this file so when spiders crawl your site they do not index what you dont want them to, Google Yahoo etc # Add this tage to every page