A good marital relationship needs to be based on trust. In order to trust your partner, he must be trustworthy. Ask yourself if he is trustworthy?
It seems that he has not been upfront with you. You say that when you broke up over a 4 week period, he tried to get back together with the ex-girlfriend. And he said he would get out from the house deal, but he hasn’t. You also say that “he gets very, very angry with you”. Do you believe that this person is committed to you, and again, can you trust him? If your best friend was in exactly this situation, what would you advise her?
If this relationship lacks trust and respect, then this is a red flag.