User-agent: wget Disallow: / # /naam/ verbied de index.html en /naam verbied de gehele map User-agent: * Disallow: Disallow: /bouwtreffer Disallow: /bouwtreffers Disallow: /buienradar Disallow: /dbase Disallow: /images Disallow: /ironside Disallow: /kelfort Disallow: /klimtreffer Disallow: /klimtreffers Disallow: /klimweb Disallow: /log Disallow: /oxloc Disallow: /proxy Disallow: /stats Disallow: /usage Disallow: /webmail Disallow: /inbewerking