I drove a 2007 335i for the first time a few weeks ago. I have to admit that it was fantastic to drive. I want one now, even though I know it wouldn't be as practical for me. I'm starting to think I should buy a car I can enjoy driving fully again before gas powered cars go away. It's a bit small for me. It would be impossible for anyone to sit behind me when I'm driving because I'm tall. I also don't like not having a spare tire. The other thing to consider with the x35 cars is the fuel pump issues.
The 328 makes perfect sense if you are on a tighter budget and want lower cost of entry, better fuel economy, and less risk of fuel pump problems.
The 528, I don't know, I think it would still have reasonable performance. According to this site, you get 0-60 in 6.5 instead of 5.5 seconds. It's not fast, but it's reasonable for a large sedan.
http://www.zeroto60times.com/BMW-Bimmer-0-60-mph-Times.html
To the original question, I have zero feeling of the 5 series being a chick car. I see a lot of girls driving 328s, but It doesn't really seem like a chick car either, except maybe a 328 convertible.