A good way to do it is to get a credit card, slide it under the heatsink, then use a flat headed screw driver to pop the heatsink off. I just did it on a voodoo 3 2000 with no problems and I plan on doing it to my Radeon later tonight. The credit card is basically there so that you don't scratch/damage the actual card.
Good luck, it's a relatively easy process.