This can be nice for a lot of reasons. My Main computer is a 6core i7 with 32GB of ram and 10.25TB of storage in an incredibly large case (even has wheels). It is basically my Data server, VM host, and gaming system. I like the idea of turning it into a gaming server and setting up a couple of $300 streamers around the house using some Pentiums or A4's. I wouldn't need to be at or move my computer to play elsewhere and I would be able to play games at full settings on all of these computers instead of being sad I didn't triple the price to make a halfway decent gaming computer.
Heck I could probably try to get esxi setup on that computer and try to get VT-D working in feeding my graphics card through and turn it completely into a server.
I don't think you need VT-d for video. My "server" uses 2 video card, a tesla and a quadro4000. I used the tesla to do computing when login remotely using RDP, CUDA is available under RDP with the tesla card.
I can remotely RDP onto my server and play 1080p blue ray video in mkv format using windows media classic and everything run smoothly. There's no need to "stream" anything. To get 1080p mkv to run smoothly, my client need to be ~ 1GH Pentium M; Thinkpad X40.
I can also remote RDP onto my server and edit video there using sony vegas with cuda/hardware acceleration.
As long as RemoteFX setup properly, I don't see why people just can't RDP into a faster computer to play game on it. There's no need to do any streaming.