I'm not sure if this is helpful advice, but it definitely sounds like you need to get them into a puppy training class. Most discipline issues with dogs is because no one ever established the alpha position with them. Also, I personally believe dogs shouldn't be outdoors all the time. You will create a better bond with them if they are allowed indoors, sleep indoors, etc and are treated as part of the family. Of course, you'd need to go through potty training with them, but if done properly that shouldn't take too long. I'm also a big believer in properly using crate training (indoors, in case you aren't familiar with the concept). Not only can it simplify the potty training process, but dogs view it as their den, a safe place to be when not with their masters. They can't be left in them for endless hours, but it's a good way to keep them out of trouble and let them feel secure when you can't have them integrated with the family or while away from the house. It sounds to me like you and your husband need to sit down without the emotional charge and make a gameplan on how best to train and integrate them into your family. It sorta sounds like once you got them they were given a little spot in the yard to live, but I'm hoping that's not the case. If it is, that's likely the root of your problem. I highly suggest picking up a book on raising puppies and looking into getting them into a training class. That should be a good start! Dogs can be such a wonderful addition to the family, they just need some good guidance just like a baby. In many ways, puppies are like babies and need similar guidance, rewards, etc.
I hope that helps!