Well it sounds like you had very good reasons for breaking up with him. But did you express why exactly you broke up with him when you did?
And for the whole friend thing, it will take some getting used to. I say you should reach out to his/your friends and tell them also why you broke up with him, because then they will understand more. As for hanging out with them, the only real thing I see that you can do is get comfortable with hanging around him. If you ever need anything just IM me