Goat milk is a staple at our house. It's usually more expensive than cow's milk, but it is absolutely worth the extra pennies. As some posters have said, it's much closer to human milk than cow, so it's much healthier, as well.
If you get it fresh directly from a farmer, it's usually pretty cheap: especially if you can buy a large quantity. Here's a tip my family uses: We just pour it into quart or gallon zipper freezer bags (carefully hold the top of the baggie so it doesn't flop over and spill the milk everywhere!) and then gently squeeze out as much air as possible, seal it, mark it with the date and freeze it. All you have to do to use it is take it out and leave it in the fridge (in a bowl or some container, just in case. Don't want it leaking!). Once it's thawed, use it as fresh.
My kids prefer goat over cow. They've been drinking it since they were tiny, though. They occasionally get cow milk, but more often we'll drink rice, almond, hemp, soy, oat, etc. Goat is their favorite, though!