what I noticed with both of my boys, when they spit out the pacifier at the three month mark...that's when I broke them of it. I didn't have the hassle of trying to "break" them of the binky.
As for the bottle, same thing as soon as they could crawl or walk and something else interested them, that's when I took it away. I can't help you with the pinky, other than stop letting your child suck on it, yeah, it'll be hard for a few days, maybe a week, but would you want to be walking around with your 11 month old or 12 month old with your finger in his mouth? I think not. I think in some way, you're attached to it too. I remember having my child do things that I thought were "cute" at first, then they became habits, then I realized that it wasn't such a good habit, and then when they stopped I felt sad or empty, like "the cute thing we used to do together is gone". Always remember its a memory that you'll always have, but time to move past it.
And as soon as the little man starts walking (about age one) slowly reduce the use of the bottle (if you're not nursing) and introduce sippy cups and spoon food. Best thing I ever did! I remember my little brother was 4 when my mom finally broke him of the bottle and pacifier. UGH!
Be strong! A mother is still be loving and affectionate regardless if you have your finger in your child's mouth or not.