A.L.
My theory on this dilemma is, you can always find some job. You can't ever get back the missed milestones or time shared with your kids. If it were financially necessary to go back, I'd say go. However that doesn't sound like your situation. I think you know the answer in your heart. Follow it!