I think you need to do a combination of "promoting what your children want to do" combined with "allowing your husband to be a parent in his own way, same as you being a parent in your own way".
Imagine a single-parent home (hard to imagine the specifics, but in general): If you were the only parent all the time, you and your children might be out doing activities frequently, going to other neighborhoods, going skiing. But, if your husband was the only parent, he might be telling the kids to stay indoors and entertain themselves frequently, because he was tired and wanted to stay home after working.
There is nothing really "wrong" either way. Neither of you is ignoring your children (your husband wants the children to be near home *with him* - he's not saying "the children should go away while I stay home and rest").
Since you are fortunately not alone - your household has TWO parents - you need a balance, neither of you needs to be telling the other "how to parent". (Just like if your husband washes a dish and then you micromanage and tell him he did it wrong...you should each be able to wash a dish your own way, rather than anyone making one person feel bad about their dishwashing skills to the point they don't even want to try.)
It's not exactly about arguing over which way the children would prefer to live their lives, it's about sharing parenting duties.
So I think the balance is: teach your children to enjoy life "both ways", and find the parenting balance with your husband.
If you want to make it simple, divide the week into "being active Mom days" and "around home Dad days". And decide with your husband in advance: "Wednesday is a 'being active' day - we're doing Halloween with the Smiths over in Sunnytown. Saturday is a home day - we'll rent a movie, do a puzzle, stay home all day." (And - as part of teaching your children to "enjoy both" - have some home days when Dad is not around...not just "Ugh, when your Dad is back we have to stay home, I know that is SO BORING".)