#limite access to known unwanted crawler User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WebBandit Disallow: / User-agent: EmailWolf Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Crescent Disallow: / User-agent: SiteSnagger Disallow: / User-agent: ProWebWalker Disallow: / User-agent: WebBandit/3.50 Disallow: / User-agent: BunnySlippers Disallow: / #limite access to images subdirectory User-agent: * Disallow: /images User-agent: * Disallow: /admin User-agent: * Disallow: /clients User-agent: * Disallow: /CMS User-agent: * Disallow: /Database User-agent: * Disallow: /help User-agent: * Disallow: /include User-agent: * Disallow: /queries User-agent: * Disallow: /update