They will have about the same height image (maybe 1/2" shorter) and will gain width. So watching non-HD programming, they will have the same size picture and probably a picture with more grain when compared to the tube TV.
Yes, depending on the content, it might be no improvement whatsoever. A 32" displaying 4:3 content is the equivalent of a 26.1" TV. I upgraded from a 27" CRT to a 50" HDTV, and it's great. I started by looking at 32" TVs, but then I started to research things. I realized that at 10 feet from a 32" TV, one can't discern very much detail from HD content. At the end I actually wanted to go with a 60", but my budget wouldn't allow it.
I wouldn't use the we're-used-to-a-small-screen reasoning. If that were the case, then we'd never buy a car with more room and more hp, buy a house with more room or a larger lot, wear nicer clothes, etc. just because we're used to something crappier than the new, nicer stuff that's out there.
It would be one thing if a 42" were double the price of a 32". A 42" can often be had for $500 (25% more than the 32" TVs you listed), but it's 72% larger than a 32".
What you get is obviously up to you. I just want to give you information to make an informed decision. The size of the screen should depend on viewing distance from the screen since that will determine what size screen is needed in order to discern HD resolution. You might find the following viewing-distance and screen-size tools useful:
http://www.myhometheater.homestead.com/viewingdistancecalculator.html
http://www.carltonbale.com/wp-content/uploads/resolution_chart.png
http://tvcalculator.com/