Thanks guys! I went with HWMonitor for now, but will try the others soon.
Termie, thanks for putting numbers into context for me

.
All of my numbers check out, CPU is 1.00v. The temps for the cores are 29, 31, 27, 27C. The GPU is .95v, temp is 35C.
I wasn't able to find "Load voltage" or perhaps I don't know the code name for it in HWMonitor.
Also, when I took a screenshot, and then opened MS Paint, when I maximized the window the screen went black and then came back, and repeated. I restored the window out of full screen and it fixed this. For the time being, I bumped down the resolution a bit and the issue is gone even in full screen of MS Paint. But this doesn't seem good. I'm running a 24" Samsung HDTV / Monitor at 1920X1200 (although I have it turned down a bit now).
For what it's worth, I had this same thing happen from time to time on my MacBook Pro (in WinXP) using this monitor. Perhaps it's a bad DVI cable? Seems odd that it would happen on multiple computers like that... Althought it never did it in StarCraft 2, or when I was in OS X.
EDIT -- Just figured out that I'm using a single link DVI cable, and the resolution I was pushing with it was the absolute max for single link. I wonder if going out and grabbing a Dual Link DVI cable would help this issue? The fact that it happened on my MPB in WinXP in addition to my new build makes me not want to blame the HD 6850 just quite yet.