I installed that Epox beta utility, and it tells me my CPU temp climbs to 67^C when running Prime95. I ran it for about an hour each under two settings, and both times got 67^C, but no higher.
However, my apartment is not always this cool. Sometimes it can get 10-15^F hotter, and so my CPU could conceivably reach temps slightly past 70^C running Prime95.
The good news is that Prime95 seems to be the only program that pushes my CPU that far. I'm running some intensive video conversion right now, and my CPU has remained at a solid 60^C for the past two hours.
Thanks for all the comments, guys! You've been a big help!
EDIT: I have another question, though. Installing that Epox beta utility revealed my true VCORE, which fluctuates from 1.60-1.63v. I have my BIOS set to "+0.10v." That means the default voltage is 1.5v....but I thought the Sempron 2800+ was supposed to run at 1.4v. What gives?