J., You are definitely not being selfish nor are you going crazy tho it probably feels like that. You are having post partum depression. Giving birth messes up your hormones. And you are in a life situation that could make anyone depressed.
Tell your doctor about what is happening right away! This is important. This is a medical problem.
And find some way to have more support.
It's sounds like you don't have friends and family near you. Perhaps you could temporarily move in with your or his parents but only if you feel supported by them. In the "old days" families helped in these circumstances. My mother became depressed after the birth of each of her children. After each birth either a sister moved in with us or we moved in with an aunt and uncle. When my 3rd brother was born my parents split up the family so that my mother could cope. My mother and the baby lived with her sister and the other 3 of us lived with another sister for 3 or 4 months. Medicine did not recognize post partum depression and did not have medication to help. This was difficult for all of us but it was much better than my mother struggling to take care of all of us. (My father was unable to provide much support because he was working 2 full time jobs.) I have experienced living with my mother while she was depressed and that did more emotional damage to me than living with my aunt and uncle.
This is just one idea based on the way families used to cope in this situation.
Another is to join a new mom's group. Most hospitals have one. And from that group you may learn of other resources.
Is your husband a service man? The military has support also. Call them. Perhaps seredipity is at work. One of my friends has a daughter who was in the Air Force but quit when she became pregnant. And as with you her husband was deployed elsewhere. She didn't want to "visit" her mother. Her husband called someone in the military and they sent someone to his wife and helped her find resources and support.
In summary the first person to call is your doctor. Then check out the possibility of other resources if you're able to do that. If not ask someone else to do that for you.
I empathize with your pain that is causing this depression and the depression that is causing pain. There is help!!!!