At this price-point, the only thing that I would upgrade, would be to throw in a 128GB or 256GB-class SSD, and another 4GB stick of DDR3. (Or thanks to Intel's Flex Memory Access technology, you could even throw in an 8GB stick.) That, and a GT710 video card for $40-60 too.
Would make a perfectly-capable "browser box", not so much a gamer box, as the Sandy Bridge CPUs are kind of ancient, at least, unless you have them overclocked to 5.0Ghz like the 2500K and 2600K do, in the right motherboard. (This mobo is NOT that "right motherboard". Don't get your hopes up, people.)
Yes, even though this is cheaper, once you add the RAM, and the video card, that HP Haswell rig is probably a better deal, although that one doesn't have HDMI output either. (You can use a DisplayPort to HDMI passive cable adapter, that's what I'm using right now for my HP Elite 800 SFF rig to connect to my 4K UHD TV.)
But for someone with a VGA input hand-me-down monitor, at the lowest price-point, this rig might make SOME sense, although you really should add the GPU, and another 4GB of RAM, and oh, an SSD. So, add that all up, maybe it's not that great a savings, to save $25-35 over that Haswell rig that comes with 8GB of DDR3, and is ready to upgrade to an SSD right away.
Oh, yeah, this one says it comes with Windows 7 Pro, so figure in your time to upgrade to Windows 10 in-place, which, with the HDD installed, will probably take 4 hours. (If it includes the Win7 Pro product key sticker, then you might be able to install Win10 1909 2020-01 version from MCT USB onto a fresh SSD, and then activate it by putting in the product key, after installing Win10 Pro.)
Edit: That Haswell HP Elite 800 G1 i5-4570 deal for $119 (now), might not be as good a deal as this one, IFF you want to "end up" with Win10 Pro as an OS. IF that's a valuable thing to you, as opposed to "just having Windows on it", then this could even be a BETTER deal than that other one.
$40 for an 8GB stick of DDR3
$50 for a GT710
$35 for a 256GB SATA6G 2.5" SSD
$77 for this base unit
total: $202, for a rig with an i5-2400 quad-core, a GT710 GPU, a 256GB SSD, and 12GB of DDR3. Oh, and Win10 Pro. That's actually NOT a bad deal, overall. Other than being 2nd-Gen Intel (Sandy Bridge).