I don't mind metal too much although I'd rather have a lighter phone. What I do mind is sharp edges and in that regard I actually prefer the iPhone 6 over the Galaxy S6 Edge (the regular Galaxy S6 is fine).
Overall, I prefer something like the Motorola kevlar or even Samsung faux leather for the combination of lightness and grippiness.
I always have my phone in a case so I don't care much either way. But no, I don't mind the feel of a metal phone in my hand,