# All robots will spider the domain User-agent: * Disallow: # Disallow directory /manager/ User-agent: * Disallow: /en/manager/ Disallow: /nl/manager/ # Disallow directory /assets/ User-agent: * Disallow: /en/assets/ Disallow: /nl/assets/ # Disallow directory /templates/ User-agent: * Disallow: /en/templates/ Disallow: /nl/templates/