I wouldn't put much stock into something just because the majority of society feels a certain way about it. Last time I checked, up until the 1950's, calling a black person a ****** was not considered offensive. The majority of society, in fact, considered it completely acceptable to call a black person a ******. Was the word therefore not an offensive word, because it was widely considered an acceptable word? Obviously no, as I'm sure you'd agree. So why, then, would you think that because a word is widely considered to be offensive, it must therefore be offensive?
It all seems very relative, to me. A word is just a word. It has no intrinsic meaning or importance beyond what we give it. It's more the intention behind the word, then the word itself, that matters.
Therefore imo, you can't be a bad person just because you're saying a word.