After ETA: smart girl! Really, your H doesn't know women well or he has some self esteem issues that need addressing. The guy I wrote about does have self esteem problems and needs lots of affirming words and actions to shore it up. That's part your job and a good place for a counselor, either a marriage counselor or a personal one for your H.
Original
I will give you a true example.
I have a friend who WAS married to a guy like this.
He was the type who had lots of friends like this. He was on the city counsel. He had lots of excuses for lunch dates. They didn't all know about each other. He would go shopping with them. He would tell his wife about some of them . He was also contacting women on the Internet to "cheat" or just lunch and flirting. He ask her for a divorce but never told her about the cheating. They went to marriage counseling for almost two years. Till she found the emails and the phone numbers, of single women, married women, women from the Internet. He was stringing 3 along while going to counseling with her.
So if you think YOU are special..not so much.