User-agent: * Disallow: private/ Disallow: cgi-bin/ Disallow: htdocs/cgi-bin/ Disallow: public_html/cgi-bin/ Disallow: assets/code/ Disallow: assets/css/