I find it interesting how, over the phone, someone can tell you that it's grounding out. The only way to verify this is visually.
Are there any extra standoffs under the mobo? Make sure. Possibly while you were installing either the board or the card, a screw fell, and rolled under the board? These thing are easy to check. Also, this is weird, but it happens. Sometimes when they solder the capacitors/resistors to the mobo, they don't cut the leads off short enough on the back of the PCB and when you install the board, the lead grounds out against the case. i'd take the mobo out, inspect it, vacuum out the case to get any stray particles of whatever out and reinstall.
Also, how's your power supply? Durons need slightly less power than the Athlons, but not much less. You should have at least a 250w power supply, 300 is preferable.
I'd start over completely. Take the mobo out, check it, clean the case. Remove/reseat CPU/memory. Boot up with nothing but the floppy/hd/vidcard/CPU/memory installed. Good luck.