# Robots.txt for domain: http://www.kenwebb.com.au/ # All robots will spider the domain User-agent: * Disallow: /include/ Allow: /