Yep, touch the soft power pins AND ONLY the soft power pins with any conductor: a screwdriver, jumper, paper clip, etc.
I had the same thing for a while and got really tired of having to turn it on and off like that, and it's quite loud when running that way. After a while I just spent the $50 and got a case.