Trust is something I have had trouble with within my marriage. To me it is a major component in the relationship and if broken, it is hard to regain. As time has passed though from our "rocky period", I have begun trusting again. I am not the type of person to turn a blind eye to what has happened in the past because, you can't change the past but you have to move on and forgive.
I have started looking at what is happening now and how the last few month have been which is much better than last year. I have also read some Dr. Phil books which have helped me regain my self esteem and helped me examine my relationships with myself, my kiddos and husband.
Perhaps for your own sanity is to talk to your husband in a non-confrontational way. Tell him how this experience has made you feel without raising your voice or expressing anger. I have done with with my husband and it freaks him out because I am calm and composed. I also have made sure my kids are not in the room. The TV is off and it is just the two of us, one on one....
Best Wishes,
N.