# All robots will spider the domain User-agent: * Disallow: /newsletter/ Disallow: /mail/ Disallow: /secure/ Disallow: /154.pdf Disallow: /154.doc