S.F.
No. Don't take this so hard. My son who is three as well is in the same boat. He is very loving to our 1 year old, and appreciates and cuddles with his daddy, but really prefers me. I try to give him all the love and adoration plus some (with intent), and he still fights over being helped to the potty by daddy or daddy getting him a string cheese from the refrigerator. We have established that daddy can help or he can wait until I can, or forego the thing...
I am always very careful when talking to my children about super sensitive things. I don't ever want to lead them or suggest something, or even sum something up for them as I don't want to place any ideas. I'm sure you're careful and thoughtful as well, but just an additional thought.
Enjoy those babies!