# robots.txt file start # Exclude Files From All Robots: User-agent: * Disallow: /db/ User-agent: * Allow: .htm$ # End robots.txt file