First of all... You owe no one an explanation for choosing to have or not have another baby.
This is a joint decision between you and your husband. No one else has a "say" as they are not the parents who solely support this child financially or emotionally.
This is a very personal decision for you and hubby. Think about the extra financial stretch it will take, how your lives will change etc.
We were both on the same page and felt very complete with our one child. No regrets whatsoever and she's had a full 19 years of support, guidance, financially, emotionally and having a stable home.
Think long and hard about what you and your husband want and forget all the busy bees trying to get into your business.