Walking away is okay. When the thought comes to mind, "I'm not happy" or "I'm done with this", walk away knowing you're acting in your own best interest. I love the phrase, "Take the lesson, leave the teacher". Express gratitude and be on your way. There much to experience and discover without the limitations.