I'm only responsible for what I say, not for what you understand. Although as an author I am responsible for making readers understand--a reader who doesn't understand is an unhappy reader. (And there is some value to leaving some questions unanswered.
The only people who are mad at you for speaking the truth are those people who are living a lie. Keep speaking the truth. Some people believe their own truth, just because they can't handle a person with a borderline personality.