http://www.ieiworld.com/publication/news/content.aspx?id=0A061419404989468924
Here's essentially what I'm talking about. I don't see why these cant be x1/x4 add in cards and with a driver stack for windows scheduler, have the main CPU/ram go into sleep state while the daughterboard takes care of idle and ultra low power tasks. We see quad-core Z35xx Atoms in phones now, surely an x1 slot on a motherboard could power that. There's Bay-Trail quad core tablets going on sale for $65 left and right. The price without the screen/emmc/modem would make it even more competitive.
Atom Medfield in a phone.
Atom+Ram could easily fit on an expresscard without all the unnecessary fluff (GPU/MMC/MODEM) needed for a standalone phone/tablet.
WiiU/PS4/XB1 all use arm cores for standby IIRC. Why not after three minutes of idle without multimedia or compute going, swap all the needed ram into a 2GB/4GB module on the atom and put the main CPU/RAM into sleep mode. A baytrail atom is decent enough as it is, and extremely efficient at idle. During times of extreme compute, have the driver stack allow for the Atom daughterboard provide acceleration for user inputs and windows overlays while the main CPU is busy. This would be extremely helpful if your main CPU was a dual core. System responsiveness would improve greatly.
Because in super power consumption constrained situations, you already have low power CPUs with very low idle power use, and your significant draws are things like the display.
Plus since the PCIe lanes come from the CPU you would still need active areas of the CPU in order to run the add-in card, so your power reductions would not be that significant.
You wouldn't save enough power for the added cost to be worth it in non-power restricted situations such as a desktop computer, or even a SFF PC, where the size would make it unmanageable.
http://www.anandtech.com/show/8941/gigabyte-gbbxi7h5500-broadwell-brix-review/7
7.7w for a NUC using Broadwell. How much power do you think using Atom at idle would save? How much sacrifice in terms of space and cost would you need to make? That's not even the lowest power system, since there are 6w ones as well.
Your suggestion doesn't make sense in the current marketplace because there's nowhere for it to reasonably fit in. What you would need is an Atom core on the main CPU which takes over when the "proper" cores aren't required, like big.Little, and a daughterboard or module isn't effective for that.
Your RAM idea is also silly as you would restrict your main system RAM to whatever the Atom board could hold, or you would have an incredibly slow switching process because you would need to load data from the RAM to disk drive and then back to RAM on sleep/wake of the main system, e.g. if you had 8 or 16GB RAM.
In modern systems basically all inputs go through the CPU, so do the PCIe lanes. That means any interaction between inputs and your Atom input-handling CPU would have massive latency compared to using the main CPU as things would go input -> CPU -> Atom -> CPU rather than input -> CPU.
You haven't presented a sensible or viable use case or problem which your proposition solves or deals with in an effective manner. The most realistic way would be for Intel to replicate big.Little on its own CPUs with an Atom core or two.
Oh hey, here's my thread from 2.5 years ago on the topic:
http://forums.anandtech.com/showthread.php?t=2279950
Where people discuss low power modes on Intel's main CPUs and Intel adding additional power states to reduce the power consumption of their larger CPU cores.