Hmmm, very interesting.
As an amateur I'll give my thinking a spin ... 😉 I am sure some people will laugh at my efforts of troubleshooting, but what the heck, I hope they enjoy it:
First, the the very obvious: is there any juice in the wall outlet? (fuse...)
Then:
Is the tiny speaker emitting sounds?, or is it broken?
Are any fans (HSF, PSU, case fans) spinning?
Any LEDs on the mobo? Do they light up?
I assume that the periferals are working OK because they could not affect the comp in such a way that it would not start at all.
Therefore it could only be the PSU, motherboard, CPU or some switches (Power, reset, temperature protection):
Have you checked that the tiny speaker works OK? because ... without RAM, the computer would beep. With a broken GPU the computer would beep. If all is silent, then the speaker may be broken too - that has happened to me and it took a hell of a time to find that problem...
OTOH: if the CPU only was broken then the PSU would start - are any fans spinning? So the problem is narrowed down to PSU or motherboard or one of the above namned switches.
If the nothing really happens (i.e. no speaker sounds, no fans spinning) the it should be the PSU. Isn't there a fuse inside the PSU?
Just my 2 cents - you probably thought of all these possibilities ... 😉