If it is the 2-pin fan connector that is giving you grief, try wedging the connector with a small, flat piece of PLASTIC. Avoid anything that could be hard enough to scratch your card should you slip. I made the mistake of using a small screwdriver tip to pry the connector out and put a tiny mark on my card- luckily, no damage done, but I was sweating until I got the card back in and powered up.
Needle nose pliers will also work if you have a pair with good enough grip to pull the plug out. Again, be very, very careful.
On the bright side, once you get the fan connector off, the rest of the install should be a breeze.