S.W.
dear H.,
i could post a 10 minute response with lots of details and examples but i won't....what i will do is boil it down to my hard earned experience....
with relationship to these types of decisions, if your "gut" tells you to move him back then do it as soon as humanly possible!
there is nothing more accurate than what i call the "mommy alarm." i can say, and mine is 8, that i regretted every single time i overlooked, or tried to talk myself out of, listening to that mommy alarm.
i am sorry if i sound like an hysteric but that inner mommy voice is indisputable and should be attended to at all times. things may never be perfect but if you let that be your initial guide, better decisions can be made, for you all.
best of luck in everything!
S.