Hi L.,
While I can appreciate your husband's concern over past issues and problems, it is unfair to cut your daughter off from her father unless he poses some sort of physical danger to her. I get the impression that by giving him your address, you're concerned he might show up on your doorstep unannounced.
I think the idea of a post office box is a good one. As long as you can afford it, make sure you get one that's large enough to hold small packages. If something comes in larger than will fit, the post office will notify you and you can pick it up at the desk.
This will still enable him to send his daughter cards, letters or gifts and will maintain your physical privacy. If he wants to have phone contact with her, give him a cell number . . never a home number, which can lead to your home address. I suggest if he ever wants to have physical contact with her, you do it in an area away from your home and make sure someone is with you, because there is always the possibility he could follow you home.
I hope this information has helped you somewhat.
C.