Once, I was installing new RAM in my aunt's HP desktop (damn those things are silent, esp. teh PIII 900 MHz) and it was on, and I didn't know it, and I plugged in a memory module, and I was like SH*T! But, to my surprise, it did nothing bad! Just unplugged the POS computer, put in the RAM stick, and booted right up!
Interesting.