Matching games-- have you considered 'real life' type things, like a fruit and veggies set that can be 'cut' with a wooden knife and then velcro'ed together?
Ravensburger makes some childrens matching games and the cards are on much thicker stock. They have "4 First Games" and one you might enjoy is a very simple 'Snail's Pace Race'-- the beauty of it is that it teaches very basic counting/moving (up to two), and it's cooperative everyone is moving the snails along. No worries about losing.
Another toy which might appeal are self-correcting matching cards. Ravensburger has an Animal Babies and their Mothers game which the kids I taught loved to death. They also have an alphabet/picture match (the first phonetic letter of each illustration corresponds to the letter, cards are self correcting) called Airplanes to Zebras.
Letting him play and sort with collections of things is also fun. Go to the beach and collect a bunch of colored rocks; sort them into different colors. Ditto for buttons or if you have a wide collection of thread spools (my son used to get into my plastic case of thread, take them all of the spindles in the case and stack/sort them... he LOVED this at this age).
Lastly, I cannot forget to mention Playdough. Those fine motor skills are vastly improved with playdough play. It's a safe medium for learning how to cut with scissors (roll them in to skinny 'snakes' and let him cut them), cut with molds/cutters, to pinch and shape. You can do lots of teaching about letters/numbers, shaping them with the dough. You can make lots of little things and count how many of each. Give him craft sticks to use-- my preschoolers loved to make 'happy birthday cakes' and sing the song, complete with craft stick 'candles'.
And if you want a fun math game, here's one with lots of room for adaptations, the link is to my post on this game "Dino Drop" I wrote for my own blog:
http://skyteahouse.blogspot.com/2012/02/dino-drop-introdu...
Have fun!