User-Agent: * Sitemap: http://www.intlconsilium.com/sitemap.xml Disallow: /js/ Disallow: /includes/ #Disallow: /admin/ #Disallow: /login/ #Disallow: /templates/ Disallow: /flash/ #Disallow: /videos/ Disallow: /css/ #Disallow: /captcha/ #Disallow: /members/ #Disallow: /_archived/ #To prenet any images from being scanned #Disallow: *.gif #Disallow: *.jpg #Disallow: *.png #Block out things that are secure or login oriented #These are based on not using any rewrite rules Disallow: /privacy.php