I would not buy a townhome (or a condo) around here. They are typically bad investments because all it takes is a few units going downhill and the whole place can be devalued relatively quickly unless the location is prime. It gets worse if there is more competition or construction in the area to drive prices down. It's rare that 20-30 year old condos are worth a lot more than when they were new unless they are in the city center or near other attractions.
Having said that, consider the costs of a neighborhood with a private pool, rec center, etc.. If you get a workout facility, pool, outside maintenance, etc....many of those costs may offset if the HOA fees aren't too high. Square footage of the workout facility, for example may offset square footage required for equipment in the home.
You should look at comps in the area for both property and see what the value is. Figure out how often you want to go out and go downtown and see if there's value there. Now that I'm in my 30's with kids, my desire to go out and spend money has decreased. I'm looking more at investing in what matters more to me.
Old homes have problems, but consider that homes built in the last 30-40 years in many parts of the country are typically constructed of soft #2 yellow pine. Older homes are made of more hardwoods that will often be much higher quality.