# All robots will spider the domain User-agent: * Disallow: # Disallow directory administracio User-agent: * Disallow: administracio # Disallow directory cgi-bin User-agent: * Disallow: cgi-bin # Disallow directory CSS User-agent: * Disallow: css