I'm with you, Bogg. I've suggested something similar in the past too. I think it makes a LOT of sense, at least to me.
And for those claiming that there aren't enough pins, what about two, or three stacked card-edge connectors? I think that the Xeon slotted CPUs utilized two rows, and Neo-Geo cartridges definitely did. Although, if CPU "carts" get that large, hmm, dunno. Maybe an AMD mega-APU? 300W with integrated water-cooling? GPU and 32-core CPU in one?
Edit: If CPUs were in the form-factor of a Neo-Geo cart (roughly VHS-sized, if you've never seen one), it might make it more likely to be upgraded during the lifetime of the PC. Or it could allow for just-in-time assembling of PCs, build them, and slot in the CPU just before shipping. Either way, you wouldn't need a tech, or to be a tech (like us), to swap CPUs.
Edit: With the larger-sized carts, maybe they could included HBM2 or 3DXpoint NVDIMM-P soldered to the CPU cart, much like the L2 cache was soldered on to the Pentium II Slot-1 carts.