The space heater I used a couple years ago was great on electricity. It took a little bit to warm up the place, but once it got going, it was damned cozy and with very little added expense.
If you're going to sleep with it on, make sure you get one that will shut off if it's knocked over and don't be stupid about where you put it and what you put around it.