D.N.
If you have anything establishing sole custody, you should be able to present that to get the passport. You might also be able to complete the special circumstances of a passport application if you have a restraining order.
A friend of mine had moved to get away from her abusive boyfriend-to her and the kids. She had a court order of protection and as far as I know was able to get the passports without a problem.