G.N.
(((HUGS)))
Like others, I also realized the amount of time my son spent at daycare vs. with us was way more than I would like.
I always thought that he thought we were the crazy nutty family that took care of him when his daycare mommy couldn't. I spent the first 12 weeks of his life with him though and I could tell that he knew ME when I first took him to daycare. The bond he developed with them overtime was bound to happen. How could it not? It's perfectly normal. We did try to go visit him often though (like you are) and that helped me feel better.
To this day, even though my son knows who we are (mom and dad) and even though he loves us, he is a very happy boy when he's taken to daycare.
The daycare providers should show him to be happy when you come in "Look, mom is here!" so that he gets reminded by his favorite people who's who. Perhaps you should take some pictures of you and your family to daycare so he's got some reminders there.
Also... I have seen some children at daycare call the teachers "mom/mommy" but while that looks incredibly painful for the mother, I noticed that the kids called ALL adults "mom/mommy", male and female. So it's not so much that they're transferring their love to them, it's just that they think all adults who take care of them are called mom. They eventually learn that's not the case. Mom is mom and everyone else is not.
Talk about your feelings with your husband. That helped me out a lot! Get some bear hugs from him and things will feel manageable. :)