PCI based flash storage is ridiculously fast. I've recently got one for my ESXi datastore and won't look back. Can't wait until the price is at the same level as SATA SSD.
For workstation and typical home server, I don't think anyone can tell the benefit over SATA2/3 SSD. The different is only there when a bunch of VMs pounding at the same time.