T.W.
I say go for it :) The more you expose kids to things early on, the easier it will be for them to love it :) He will let you know if he is afraid or whatever, just do it slowly, and keep trying.
I brought my kids swimming in Lake Superior when they were tiny, and they LOVED it. That water is freezing compared to any pool :)