L.L.
Yup! I totally do this! I'll start by saying that my husband is a devout Christian, but is unable to go to church. At home we read the Bible daily together and pray, but I just need to go to church.
I started with mine early, so you'll have a little struggle getting them used to it, but they WILL and hopefully they'll grow to love it.
Okay, I started going back to church when my oldest was three. At that point, she was the only one, and it took her a bit to get used to going into her own Sunday School class...so I'd go early, sit with her for a bit, and then leave before class started. The teachers were SO sweet, and she got attached pretty quickly, and plus the other kids were great.
When my stepdaughter started staying with us weekends (this was when my oldest was 4 and SD was 6) then I took them both. No problem at all.
I have a new baby, who is ten months old. I only took two weeks off from church after having her, and we were right back to it. At that point, other children were 5 and 7. I just brought baby into Sunday School class WITH me, fed her under a cape, etc...and if she cried, I'd walk her around in the foyer for awhile.
I am the pianist for my church, so while I am playing (and I have to go downstairs, play for the Hispanic service, and then come up and play at the beginning and end of the English service) I used to have someone just hold the baby, but now she won't have it and cries so I just have to put her in the nursery. She cries a bit, and then she plays. I go get her as soon as I can, and take her back in at the end of the service just to play the last hymn. If I didn't play, I'd just keep her with me during the church service. THe other children just sit in our pew during the church service and I have another woman who sits with us, but they don't really "need" it...
As far as the boredom, I let them bring a backpack with books, coloring books, and crayons. No toys, nothing noisy...but they do have Sunday School, and when they are older I will expect them to pay attention in church, but not yet. THey are still young. They get plenty from SS and from home. I bring snacks for the baby and some favorite Sunday only toys.
And I'll say this...it is TOTALLY overwhelming. I have to bring so much stuff, my husband is not up in the mornings so I have to shower, dress, get them fed and dressed, and get everything out to the car on my own. I live in Minnesota, so if it's winter, I have to manage to shovel the driveway, scrape the windows, and everything else.
I have to tote a TON of stuff into church (of course, the older ones help and I take my stroller in to help carry stuff...everything BUT the baby). But the older children are so used to it when we get there they just go right down to their class, come up when they are done, and go sit in our pew for the service, where they've already left their bags so they are ready to go.
Overwhelming? Yes. TOTALLY WORTH IT? Yes. I look forward to it every week, I think it has SO MUCH value, and you should absolutely try to do it...even if it is overwhelming. If you have any questions on how to handle anything, I know I can help...I've been doing this with children for years...but I think I've covered everything.
Sorry to be writing so long, but I so want you to go to church! :)