# Unwanted scanning of very long URLs which generate too many cache files User-agent: ltx71 - (http://ltx71.com/) Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Amazonbot Disallow: /