From what I've read on the topic from the engineers standpoint (as if I pretend to understand 100% of it) we might see quantum gate processors before light (wave state / transphasor based) processors.
Current transistor technology is based on basic electron propagation, and while it's hitting a lot of technological walls, like clock speed, other improvements in processor design are helping keep efficiency moving forward. With a light wave based circuit, even though you have a lot less energy and heat to deal with, there's also less to work with. Flipping a light wave based transistor on/off might seem easy in a lab on small scale (I've seen this done with simple crude polarizers or magneto/optical), but trying to increase the scale to millions of gates creates a lot of hurdles.
One scientist had an interesting quote that there just isn't a practical/economic way to migrate to optical based circuits in the short-term, and that's the hold back. Then again Microsoft will need 1000ghz computers for Windows 9 just to run the GUI.
Had a great conversation with a buddy of mine back in the early 90's while he was at Rensselaer Polytech. Basically, we didn't see the need to develop quantum based processors because one in the future had already calculated every particle/location/energy state in the universe. Now I'm starting to get dizzy and need to stop typing.