L.S.
It sounds like he's not ready yet. Some are like that. My son didn't start eating until 7 months, but he's still a great eater now. He did the exact same things. Don't worry if he's not eating food right now. Food the first year is just an experiment. They should still be getting their nutrition from breast milk or formula (and not food). I would just give it a rest for a few weeks and then maybe try again. He'll be eating soon enough.
http://www.kellymom.com/newman/16starting_solid_foods.html
http://www.askdrsears.com/html/3/T032000.asp