It depends on soooo many factors.
Can you sell your current house? Does it need to be renovated for a sale? How long will it take to sell the house you are in? Would you be able to pay two mortgages until it does sell?
Now is a great time to buy, but not if you have two mortgages to worry about.
Will you have a smaller payment with a larger house? Have you seriously started looking to see what is out there? Would you have to keep working to pay for the new house? Would this be something you would want to keep doing?
Personally, I think if you could make your financial committment lower for a larger/or better planned house, it is worth it....if it is done smartly.
As far as a part time job.....you may like to do that regardless. :) I love working 9-10 hours outside the home. It gets me out 3 nights a week for 3 hours at a time; it gives me something to focus on that isn't my family (directly), allows me to keep my mind sharp, and feel needed in the community (I work in a Boys and Girls Club)....oh, and I have a little extra money that makes doing things much easier.
Seriously look at what there is for sale in your area. It will either excite you or make you realize how good you may already have it. :)