Stop giving him toys, would be my suggestion. My doesn't care about all that stuff. At that stage, when starting to walk, all they're interested in is exploring what's around them.
I have the musical table, and it's a great point to stop for a bit. But mostly, he wanted to explore the room. Touch things, reach things he couldn't before. So I'd just take all of the dangerous things out of his reach, and let him go around the house.
My son loved little things, like remotes and calculators. Things he could reach, and we let him explore. All that money wasted on toys that he never touched.
PS: walkers are perfectly fine as long as your house is childproofed. They've gotten a bad reputation because a few people in the past tuned out and their kids walked into fireplaces or tumbled down stairs. They're terrific, as long as you have that stuff safe.