User-agent: * Disallow: /cgi-bin/* Disallow: /data/* Disallow: /errors/* Disallow: /logs/?*