I would suggest it. It's always a good idea to remove the driver when changing parts even if they are similar. Do it right the first time then you won't have to mess with it again.
Once, I forgot to uninstall the video drivers for a card that I was swapping out and I messed up the puter so badly I had to do a clean install.
-sp