This is based entire on what I've read, but I think you're fine with the 40.82 drivers for the GF3. I heard that it's best to use 45.xx or lower for the GF3/GF4 cards, as the versions past 45.xx are optimized for the FX series of cards.
Currently running one of the 45.xx series (can't remember the exact one) on my brother's GF4 Ti4200.
You might try using the older 30.82 drivers and see if you get any performance increase in your particular games. Otherwise, I'd probably just stay put unless you are having problems.