User-agent: * Disallow: /thunderdownload1.asp Disallow: /thunderdownload.asp Disallow: /d.asp Disallow: /d1.asp Disallow: /test.asp