User-agent: * Disallow: /pdfs Disallow: /cgi-bin Disallow: /images Disallow: /gif Disallow: /jpg