Electronic sound from an energized system is normal. If the power is on even when the system is 'OFF' power is still reaching the motherboard.
If you have indicator LED on the motherboard there should be a Yellow one on indicating a 'Hot Board. If you turn off the power - or disconnect the
power connector, the electricity stored in the capacitors decays and the LED goes out and the noise stops.