I'm sure you could it just wouldn't perform as well but if you aren't overclocking, it'll still beat a stock HSF. You might look at the Thermalright SK-6 as it performs similarly and some vendors sell it without the fan so you can just choose which one you want. Take a look around this forum as there have been a couple of threads in the past few days from people who did just that.