# /robots.txt User-agent: * Disallow: /images/ Disallow: /admin/ Disallow: /archive/ Disallow: /Library/ Disallow: /Scripts/ Disallow: /Templates/ Crawl-delay: 10 User-agent: wwwster Disallow: / Crawl-delay: 999 User-agent: YahooSeeker/CafeKelsa-dev Disallow: / Crawl-delay: 999 User-agent: e-SocietyRobot Disallow: / Crawl-delay: 999