The way I see it, this thread comes down to what an individual prefers based on what they find convenient or inconvenient, possible or impractical for their personal phone usage needs/habits.
There will never be a single right answer or conclusion for everyone. Ever.
That being said, from my experience, I don't care about having a removable battery. I find it rather simple to understand that particular limitation of my phone and to make allowances for it as necessary.
Of course, I wouldn't mind having a removable battery if it didn't affect the capacity of the battery. However I find battery cases more convenient than a removable battery but their availability is limited based on your phone. It is the one thing I miss about using an iPhone (have an HTC DNA now).
-KeithP