I have an adenoma on my pituitary gland as well. I produced high amounts of prolactin which was found in blood work. I took a medication (it was over 15 years ago, so I don't remember what) for a period of time and then stopped. I have MRI's with contrast every 2 years. My OB/GYN found it because I had had several miscarriages and the symptoms I was giving him he diagnosed me and then did the tests and he was right. He told me there was no reason to do surgery unless the adenoma began to grow and then it could effect my vision. He could tell by the shape/depth of the adenoma it was benign. I monitor it closely but have had no problems and like I said it was found over 15 years ago.
Please remember you have options if you think the doctor is too agressive. Surgery may be the answer for you, but if you're not comfortable with it, go to someone else for a second opinion. I worked in doctor's offices (specialists and surgeons) before I had children. Some are "not happy unless there's a patient asleep on the table to work on" and others are more conservative. You need to find someone who matches your thinking and don't allow yourself to be "scared" into doing something you're not ready to do.
I don't know where you're located. My sister was a P.A. at Presbyterian in Dallas until she retired a couple of years ago. If you need some more names, let me know and I'll see what she knows.
Blessings!
L.