For analogous models, base vs i4, type S vs V6, the accords are faster and more torque. Bigger car and roughly the same cost.
I have a I4 accord, it's very easy to drive. I almost never have to spin past 3K to get past the speed limit. I'm very happy with the car. Stock for stock, the RSX will handle better, but the accord can be made to handle very well with simple swaybar upgrades.
But there are more mods for the RSX if you like to tinker with cars. One of the nice things about the 05 RSX-S is that it's very close to the RSX/Integra type R in japan. It has ITR cams, heavily upgraded suspension and 17" wheels now.
Don't forget to get insurance qoutes on the cars you are considering and of course test drive them all.