# prevent User-agent: * Disallow: /administrators/ Disallow: /vadiba/ Disallow: /datnes/cache/ Disallow: /datnes/public/avatars/ # allow ia_archiver to visit User-agent: ia_archiver Disallow: