With that many games impacted across various engines, either your performance is perfectly normal for your system, or there is a more systemic issue manifesting itself in certain instances.
Are you suffering from *sustained* low FPS (you said ~40?), or micro-stuttering? There is a big difference, and a lot of people here are assuming you mean the latter, but that assumption is at odds with your OP, so please clarify.
Run 3DMark11 and compare your scores (both the total score and the individual ones) to the other 100 people on Earth who own ~4 580's.
If you want some help spot checking, take a screenshot from early on in level 1 of Future Soldier (preferably without much going on to de-stabilize the frame rate) and paste it. I can then check to see what I get in the same spot. I have fewer 580's than you, but it should be a good sanity check, at the least.