J.P.
First Time Mom--welcome to the world of motherhood guilt. It doesn't matter if you work 100 hours a week or are a full-time sahm, the guilt will follow and eat you up. Take a deep breath. I'm sure it seems like you can't do anything right, but just trust yourself a little more. And trust me that it WILL get easier. The baby will not be permanently damaged by your tough schedule: the LOVE i s what's important. Just focus on the love you feel for him. It will transcend all your other worries.
Good luck. It will all be okay.