J.T.
Probably not what you want to hear but I say let him have it. My daughter was the same way and PAT said that if they just use it at bedtime it would be fine to let them have it as a soother, as they will be having a lot of change coming up (I just had twins when my daughter was just over 2).
Ended up we got rid of her paci unexpectedly this summer when she was about 27 months old and the twins were about 2 months old. She was down to 2 pacis and they both cracked within a week of each other. We showed them to her and said they were very dangerous and she helped us throw them away, saying "bye bye paci". She had a little bit of a hard time getting to sleep the next few nights but there were no tears. She does chew on her hand sometimes but no thumb sucking.
if you do want to get rid of it now, most of my family cut them off bit by bit and the kids no longer wanted them. Good luck with everything!