I don't smoke. Many friends of mine do, and they are considerate about it.
If a smoker is considerate (i.e. doesn't light up in front of nonsmokers, goes outside, etc.) then there should be no reason for a nonsmoker to complain. But if you light up in front of people that don't smoke without their express permission then you're an ass.