Oh, boy! I may not be the one to ask, because I don't see any reason NOT to go outside when it's cold. I go backpacking in the dead of winter, and don't have a problem sleeping on the ground when it's well below freezing. I enjoy the challenge, and I have a lot of good equipment and know how to dress.
Take a little bit of time to learn how to layer and what to layer. You want lightweight wicking layers next to the skin, and then work out. In the Philadelphia area, I generally never go beyond three layers on the coldest days. And know that FLEECE is our best friend in winter! If you're planning on living here for a while, then you should really learn how to dress to be outside. Otherwise, you'll just be stuck inside all the time. And when your little one is older, you don't want her missing out on making snowmen and sledding! Yes! Yes! Take her outside! It's what we do up here!
One good thing to know: Cotton is Rotten! That's a great saying for winter dressing. Don't use cotton clothing in the winter, especially next to the skin. It doesn't insulate well, and if you get wet due to sweating from overheating or from rain or melting snow, it just zaps the heat right out of your body. Cotton socks and jeans are horrible in the snow. You'll just be uncomfortable and cold in those things.
Oh yes! Don't forget to wear a cute hat! Keep trying to get the mittens on your baby, though. Little fingers can get frostbite, and we certainly don't want that!