User-agent: * #folders to block Disallow: /images/ Disallow: /archive/ Disallow: /admin/ Disallow: /cgi-sys/ #block files Disallow manag Disallow stuff