I agree…. IF it’s the right thing to do. If it will benefit you in some way. You should never step out of “your comfort zone” if it’s not the right thing thing for you.

Jujitsu or something like that, work or that kind of thing, yeah but if certain people make you uncomfortable or you simply dislike them, find them irritating, annoying in every way or they are generally a problem, sabotage, detrimental to your contentment in life, you should never allow these people (back) into your life. You should absolutely do everything in your power to lock them out.

To do otherwise is not beneficial to your contentment. Then it is not a good idea to out of your “comfort zone”. Hard work is definitely though. So are hobbies especially if they are challenging.