# directed to all spiders User-agent: * Disallow: /c/ Disallow: /cgi-bin/ Disallow: /demo/ Disallow: /demo2/ Disallow: /i/ Disallow: /logs/ Disallow: /blog/ Disallow: /recdb/