# addresses all robots by using wild card * User-agent: * # list folders robots are not allowed to index Disallow: /images/ Disallow: /www/ Disallow: /basket Crawl-delay: 90 Visit-time: 0000-0500 Sitemap: http://www.angloscottish.net/sitemap.xml