# Domain: http://www.cgirb.com # All robots will spider the domain User-agent: * # Disallow directory /myapp/ User-agent: * Disallow: /phpmyadmin/ Disallow: /webmail/