User-agent: * Disallow: /package/rate/ User-Agent: * Crawl-Delay: 10