# How to Write a Robots.txt File # Microsoft Knowledge Base Article - 217103 # Make changes for all web spiders User-agent: * Disallow: /_fpclass Disallow: /_private Disallow: /_themes Disallow: /_vti_cnf Disallow: /_vti_log Disallow: /_vti_pvt Disallow: /_vti_script Disallow: /_vti_txt Disallow: /cgi-bin Disallow: /email Disallow: /fpdb Disallow: /image #Disallow: /W3SVC964333777 #Change ? with the instance number please. Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /data/ Disallow: /css/ Disallow: /images/ Disallow: /logs/ Disallow: /ximages/ Disallow: /rpc/pdf/