It is complicated because on the one hand you love him, but on the other is intolerable that situation, you lose confidence, affection and becomes a relationship cold and without future, it is best to take distance I would think.