Pretty similar to you. And my phone is similar territory. Actually, unless I am using it, it is typically in my purse... so off limits. LOL
I taught them from a young age... women's purses are not toys or public property. Not just mine---ANY woman's. I don't need little kids pulling private things out of my purse, ya know? Or someone else's purse, either. I have never understood the women who don't seem to care if their kids riffle through their purse. I have both private AND important things in there that I don't want lost, damaged, or sometimes even seen (and questioned about as kids are known to do). I didn't have to put my lipstick out of reach (to avoid walls drawn on in lipstick by 3 yr olds) because it was in my purse. They were not allowed in my purse.
If they want a piece of gum, they ask. If they want dental floss (when we are out somewhere), they ask. Or chapstick. Or a quarter for a vending machine. Whatever... they don't just dig in my purse.
My husband will go in my purse if he asks for something and I tell him it's in my purse (implying to go get it yourself).. but he doesn't like to. He'd rather I got it out for him. He was brought up the same as we brought up our kids.
My kids are older now (16 and 13) so I no longer have to worry about a 4 yr old pulling a tampon out and waving it around in public asking about what it is while opening the wrapper. But then.. I didn't have to worry then, either, b/c they didn't go in my purse.
I also keep money, credit cards, and a checkbook in my purse. And my purse is organized and I have a "spot" where everything is and everything is in its place. Then I can reach in and find what I need without even looking.