S.W.
What does your husband think about this idea? He's your best, closest, and most honest resource when it comes to knowing what to expect and answering your questions. Plus, if you're sent overseas and your family can't come with you, is he prepared to play the role of both mom and dad while you are gone? Serving in the military is one of the most admirable, if not THE most admirable thing a person can do. But, it may not be the best solution for you.
College doesn't have to be done in 4 years and you don't have to go into debt while doing it. It will require sacrifices, but the military will demand even more. And the military won't let you walk away if you don't like it. My brother took 8 years to get his college degree, but when he finally finished, he had NO loan debt. He paid as he went. Some semesters he could only afford one class, some semesters more. He started at a Dallas Community College for the first few years then transferred to UNT to finish his education. There are lots of great institutions in the area that cost very little per class. Community college is by far the cheapest, followed by state schools like UNT. If you're looking for convenience more than cost, online degree programs like University of Phoenix offer great flexibility for a busy mom like you. And, some employers reimburse employees for education expenses - maybe you could look for a job with an employer that offers this to its employees.
I don't know what all research you've done, but I would encourage you to do some real soul searching. Which is more appealing - 6-12 months away from your family at a time or 1-2 nights away every week for the next 4-5 years? Only you and your family can make that decision. And remember, even after you finish your tour with the military, you'll still have 3-4 years of college to complete. Are you prepared to wait that long if a better education is your ultimate goal?