64-bit linux is looking damn good. On average, about 20% faster which is nice for an essentially free upgrade.
As for Windows, the new build is encouraging, but all over the place. Some apps (visual studio is one, i believe) almost doubled, some showed modest improvement, and some were actaully slightly slower. It's pretty much like when Hyperthreading was first introduced.
When comparing 64-bit chips, look at it this way: Athlon 64 chips outperform their cheaper Athlon XP cousins by a lot in 32-bit mode, due to a much better architecture. In fact, the A64 2800+ is just as fast as a 3200+ Athlon XP. Athlon 64s generally perform slightly better than the P4, with slightly slower results in video encoding. However, since they are priced the same as the P4 (cheaper now after the price cut, since intel won't cut prices this year), you are essentially getting slightly better performance in 32-bit apps for free, plus a free boost to 64-bit when the time comes. When you look at it that way, this question becomes less important. Even if 64-bit sucks ass (which it won't) the Athlon 64 is still the best value. 64-bits is just the icing on the cake.
I guess to answer your question, if you already have a good system now, and are deciding on whether you need to upgrade, the answer is probably not yet. In a few months, the A64 platform will have an established PCI-express base, with nForce4 Ultras and K8T890 Pros everywhere. Dual core will be here soon. If you can, I'd wait until December or January to upgrade. If, on the other hand, you know you need to upgrade and are trying to decide between an Athlon XP, 64, or P4, then I'd say the A64 provides the most performance and best features, including 64-bits, for your money. If 64-bits cost a premium over the P4, then the answer may be different, but since it's "free," i say, why not go with a 64-bit chip?