# LiteFinder is to much buggy, don't know net net # (support very partially robots.txt, cannot parse relative URL,...) User-agent: LiteFinder Disallow: / User-agent: LiteFinder/1.0 Disallow: / User-agent: * Disallow: /