So about two hours ago, to be 100% sure that it was the PSU fan causing the noise, I slowly inserted a folded index card up through the fan grill into the rotating fan as it, and the rest of my system, was powered on.
Yes, I do realize how incredibly poorly that could have gone.
On the...