B.K.
Oh my goodness. Jessica is wrong! Birds have no sense of smell. It's a myth that they won't take care of a baby bird after you've touched it. This is true for mammals like rabbits, but not for birds. (My good friend is a state-licensed animal rehabber. I'm not just pulling this info out of my butt.)
You did the right thing. The baby will probably be fine. If he falls out again, you can just sit him under a bush and the momma will find him and feed him. Maybe he's almost old enough to be out of the nest.