B.R.
He may want all the kids at one time for selfish reasons, If he followed your schedule, he would not have a weekend to himself. I would find out if this is the case, if it is then maybe he would agree to one weekend all together and one weekend for just your shared children. This would leave him one weekend a month for himself.