I learned the hard way, that I cannot always count on others to respect my feelings. Even if I respect theirs. Being a good person doesn't guarantee that others will be good people too. You only have control over yourself and how you chose to be as a person. As for others, you can only chose to accept them, or walk away.
If it's challenging you, testing you, and pushing you... then it's helping you become more of who you're meant to be.