# /robots.txt for http://www.sprookjes.org/ # comments to info@sprookjes.org #Wayback Internet archiver User-agent: ia_archiver Disallow: /indeling/ Disallow: /images/ Disallow: /erwin/ Disallow: /cgi-bin/ Disallow: /titels/ Disallow: /info/ Disallow: /downloads/ #Wayback Other crawlers User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /indeling/