It's not the PSU, I put it a few feet away (so that I can hear the case on the left and PSU on the right) and I also tried it with a spare PSU, same thing.
And every core contributes to the noise a little, tested it with prime95, gets a bit quieter after each core goes idle.
As for the...