I have three. I don't think my middle one feels overlooked but there is a six year gap between him and our third child. I think this helps because he has spent a good portion of his life as the youngest child. He is also the child who needs the most 'hands on' parenting. I always feel like I am playing 'Survivor' with him. I have to outwit, outplay, and outlast him. With this said, having the third has forced him to grow up more (which is good; since I babied him a lot).
Your husband is right to be concerned about logistics. We are Disney Vacation Club members and everything is really set up for a family of four. So we do now need to upgrade to a larger room and because of our age range, there are things we can not do as well as we use to. We all like to ride roller coasters and both boys finally were tall enough. Now with the baby, we are rotating again. But these are really silly things to be overly concerned about.
What really matters is that I think we are better off with three kids. My older boys have had to learn to be more empathetic and loving towards their younger sibling. They are more helpful around the house (with my encouragement).
As a parent, you do find time for all. As long as you structure your home so that they know that they are loved but must follow the rules, I don't think you will be overrunned.
Whatever you end up with, know that it will work out. You are still fresh from going from one to two. That is a momentous change; probably a greater change than from two to three because when you have one the whole focus is one that one child. Give it some time and you will be able to figure out what is right for your family.
Good luck!