What motherboard do you have? 50C is perfectly fine, maybe you should add a few case fans, and get an ait flow going and it will bring the temp down. Some motherboards list higher temps than others, some list the temps far to low. People getting low 30's at idle is BS, that's such an insane number, if they don't have water cooling or something.
Do not compare your temps to what other people list, they have a different motherboard than you, so the temps will not be the same. All motherboard temps are wrong anyways, because their taking the temp on the outside of the chip. Some MOBOs make their temps 5-10 degree's higher on purpose to try and make up for this, if you have an Asus board, you'll more than likely see higher temps then other boards.
I'd much rather have that, then other boards that undertemp, and make you believe your getting 35C idle, come on. One other thing, your PC is NEVER at idle! The second you turn it on, it's working, in bios, its working, it's definetly not idle in windows by no means. So your temps should be "Normal Working" temp and then at a Load Working Temp.
I have 6 fans in my case, not counting any chip fans, and my temps are 48C at "Idle" and around 53C after a few hours of gaming, I also have an Asus board, which is notorious for having high temps listed, so it's probably 3-5 degrees cooler than that.
If you wanna know the burn up temp for your CPU, it's around 90C. So until you start getting above 70C, you can stop worring.
I mean when you turn on your Car, is the engine ideling? I don't think so.