# All robots will spider the domain User-agent:* Disallow: # Disallow directory admin User-agent: * Disallow: admin # Disallow directory include User-agent: * Disallow: include # Disallow directory images User-agent: * Disallow: images