Let me get this straight. He was in a relationship with you and form another relationship with another girl. Definitely beak up with him. He has already shown you that he can't be trusted and doesn't respect your current relationship. You can find someone better than him. Best of luck.