If you want to use NVMe just like any SATA drive it requires BIOS and OS support. Luckily Win7/Win8 supports it. So you just need BIOS support so you can see/use it just like any SATA device prior to boot.
I suppose if you buy an NVMe PCI drive you still can use it in Windows, you just can't boot without NVMe BIOS support. I haven't had any experience or have read much about easy or positive experiences of others including Anandtech. It's still bleeding edge.
Like you mentioned though, I feel the same way. NVMe is a bright future, but current SSDs are also fantastic and very usable for many, many years to come.