Actually, for the very reasons you mention, a lot of medicinal cannabis patients have taken to edibles, tinctures, or even sublingual and body sprays. I can't speak about the merely recreational users, but anyone who hangs out in any public space spewing smoke is a bit of a jerk.