# search engine robot file. # Use this file to prevent areas # of your website from being indexed # by web robots. # Required for all crawlers to crawl your site ; User-agent: * # followed by Disallow: /whatever name User-agent: * Disallow: /cityhouse/ Disallow: /connect/modules/ Disallow: /images/ Disallow: /cgi-bin/ Disallow: /kiwanis/_derived/ Disallow: /kiwanis/_themes/ Disallow: /kiwanis_old/ Disallow: /phc/ Disallow: /test Disallow: /modules/ Disallow: /Old%20City Disallow: /OLD%20from Disallow: /bkup Disallow: /sylviareid Disallow: /youngatheart/images/ Disallow: /invalid/