As an RD eligible pediatric nutritionist, my suggestions are:
1) do not offer whole milk in replacement of formula under one year of age AND/OR especially if he is not eating other foods that could compensate for the poor nutritional value (relative to formula or breastmilk) of cows milk. Even a 1/2 cup can make a difference.
2) If this behavior is abnormal for him, consider medical issues such as: is he teething? (discomfort in his mouth might make him resistant to any oral stimulation, or the dry foods might feel good on those cutting teeth). Or, was he premature? sometimes premature infants are more sensative to oral stimulation and have more difficulty accepting new foods/ foods.
3) Whatever you do: DO NOT WORRY or POWER STRUGGLE: He will eat when he is hungry and he will take solids when he is ready. Offer his bottle as usual, offer him a variety of foods, over and over again, even if he rejects them (research shows it can take 8-10 exposures to a new food before a child will accept it). However: Be careful not to fill him up on puffs and cereals, so that when you offer him "real food" he is hungry enough to try it. For creative suggestions on appropriate finger foods for toddlers, check your local bookstore. Some suggestions: sweet potato "fries", avocado slices, fruit, cold banana (cut lengthwise, cubed hard boiled egg, whole wheat bread (toasted, if he would prefer), apple "sticks" etc. Remember: he does not have to eat solids right now. As long as he is gaining weight and growing normally, the purpose of food at this point is just to expose him to different flavors and textures so as to increase the likely hood that he will eat and accept these various foods when he is toddler.
Also, research shows that formula fed babies have more difficulty accepting a variety of foods than breast fed babies. (Theory being that breast fed babies get exposure to new flavors that are carried in mothers breastmilk. In know, strange, but true)...All this means is that he is normal and that he just needs more convincing in the form of exposure to various flavors/textures...
IN sum: If he simply refuses to eat certain forms of soilds (or solids in general), MAYBE HE IS JUST NOT READY. Do not worry... keep offering bites of odd things through out the day (without expecting him to necessarily "accept" these new foods and textures until 8-10 repeated exposures). Your job at this stage is to simply lay the foundation for healthy eating patterns later in his toddlerhood...To that end, also: if he cries when you put him in his high chair: don't feed him in his high chair...If necessary, try a different chair in the household, or if it doesn't bother you, let him eat sitting on the floor on top of a blanket or something). If it makes you feel better: my daughter would never eat baby food or finger foods really either. In fact, even though she nursed exclusively until about one year, she didn't start really eating table food until she was about 14 months (after she started walking). She would never take baby food or purees of any kind. I offered various foods three times a day (throwing most of it away) until she was probably about 18-24 months...Now she is 28 months and eats most anything!
Hope this was helpful!
C.