M.K.
it is way appropriate to only pay for the kids. that is what the party is for right? what I would do is on the invitation put something like,
kids will have pool time from 1:00p-3p. Food served from 3p-4p. Any adult that would like to swim can pay the front desk the $5.00 required fee.
Or something to that effect.