# http://www.sxw.org.uk/computing/robots User-agent: * Crawl-delay: 30 # Directories Disallow: /css/ Disallow: /includes/ Disallow: /resume/ Disallow: /sites/