No, you're not alone, but maybe in the minority. Lol. Out of our "group" of friends, 2 aren't on and the other 5 are. I'm on it and I like it. It's 500 times better than MySpace - more mature.
I've caught up with some people I haven't seen since Jr. High and talk to some people that I really didn't know in High School, but have a lot in common with now. Actually, I'm having lunch today with 2 old friends from HS. As it turns out, we all live in the same general area now. I never would have known if I didn't FB.
You control what you put on there and what people see. I don't allow access to anyone unless I "accept" them as a friend.
I think you would be pleasantly surprised as to how much fun it is. But, it is a bit addicting.
If you still don't want to do it - then don't. I have 3 close friends that won't join. No desire at all. I tease them once in awhile, but it doesn't matter.
Have fun.