Ummmm, I think you'd be fine in taking it out (because you're not interrupting anything really...
But if you plug a smaller one in while the comp is running, unless this is some special computer, the PS could die the minute you plug your drive in. (plus I don't think it's too good on the drive)