Generally speaking, either word is pretty rude/tacky UNLESS you are speaking intimately with your girlfriend or wife.
"Breasts" would be the best word to use in a social situation in which you needed to exhibit a modicum of class.
It's knowing the time and place to use each word that makes the difference.