The first order of business is a case that breathes well- something that lets air flow thru easily, with open airways front and rear. An Antec sx-635 will do nicely, or a sx-8XX or 10XX if you want it that big. The Enermax clones are also good, don't buy one of the clones with Enhance psu- decent psu, but noisy. They're all the same basic Chenming boxes, just trimmed out differently. It's the bezel and grille design that sets them apart from others- they practically cool themselves, there's so little resistance to airflow.
The Antec and Enermax psu's are relatively quiet, while the Zalmans are supposedly very quiet. Siliconacoustics sells an open frame 300w psu that doesn't require a fan at all. It's not standard size, though, and make sure you're sitting down when you see the price....
Either a P4 or AthlonXP will run a lot hotter than your P3, so a really big heatsink is required in order to use a quiet fan. The 8XXX Alphas are among the best, as is the AX-7 and the AVC Sunflower. They'll all allow the use of quiet low power fans, like the L1a panaflos, PCP&C Silencers, some Papst and Adda models. Any of them also make for quiet case fans. On the cheap side, the GC68 from SVCompucycle and others is quiet, too, just not as quiet. Avoid boards and vidcards with chipset fans- they're usually cheap and noisy.
The Seagate Barracuda IV's are supposedly the quietest HDD's- haven't tried one yet.
Have fun, noisy computers are miserable