# Robots.txt file # For domain: http://www.awscre.com # All robots will spider the domain User-agent: * Disallow: # Disallow following directories: User-agent: * Disallow: /CGI-BIN/ User-agent: * Disallow: /images/ User-agent: * Disallow: /v2/ User-agent: * Disallow: /Connections/ User-agent: * Disallow: /database/ User-agent: * Disallow: /Templates/ User-agent: * Disallow: /listman/ User-agent: * Disallow: /bios/_notes/ User-agent: * Disallow: /backups/