He pushed me away, now he wants me back?! What's your opinion?

So this guy and i were in a relationship. He was dealing with a "big" issue in his life and he pushed me away in the worst way possible. He judged me in the wrong way and then told me he didn't want me as part of his life. Now that he got that "big problem" solved he is trying to "go back to where we were". I told him that I feel like we are definitely different people and that I think we should move on. I also said that if things are meant to be then the future will bring us together again. I do care about him still but I just feel that if he's gonna judge me and push me away just because things get difficult then he doesn't deserve me when "everything is good". Do you think I'm right about this?