User-agent: * Disallow: /*.html$ Disallow: /admin Disallow: /aspnet_client Disallow: /CGI-BIN Disallow: /Cur Disallow: /CustomerAccess Disallow: /login.asp Disallow: /doccontrol Disallow: /files