You mentioned he was at terror all day, you can't always control him at home, you're at your wit's end lately, you got rough with him finally out of exasperation and to stop his destructive outburst.
Dont' worry, this can improve greatly. You need to act much sooner with him so that you do not get so upset, worn down and then lose your temper. You need your firmest consequence ready to go on a second warning with a very clear direction of what not to do for each wrong action. Don't wait until he has you run ragged. He's definitely pushing his overstretched bounds.
Yes, sometimes kids are tired, hungry, etc. But when he is being cranky and starting to act out, and he isn't famished and overly exhausted, etc, you need to warn him to watch his tone and his actions when he very first starts showing signs of the bad attitude. Be very specific to what he is attempting, and what will happen if he does not reign it in immediately. Address each thing. Don't slack.
You should have given him a firm consequence for "losing it" when you started playing with him BEFORE he came back from the bathroom and smashed something (what do you mean fine?-at the very least he should have gotten a major consequence for THAT), and BEFORE he tried to destroy someone else's creation. The second two things would not have happened with his first tantrum addressed, and you wouldn't have lost your cool and felt bad.
You shouldn't be trying to "get through" long hard days with terrible melt downs at the end. Firm it up and tone it down. Take charge at the beginning of the day with a confident happy deep breath and a declaration that everyone will be good. Or else. Do not let him get away with the behavior. This will ensure the younger two don't start to get bad habits too.
Have a sit down with him and tell him there is a new day, fresh slate, these are the new rules, and these are the consequences to breaking them. Make it clear. Give some new privileges/responsibilities to go with it, since he's getting older. He's growing up to be a young man and REALLY needs to not be babied. Keep him busy.
It is exhausting to be diligent at first, but your life will be TEN TIMES EASIER once you have set the rules, and he's not trying to test you constantly. You'll have much more time for fun and praise. My husband travels constantly and I have 3 kids under 5. No budget for any sitters. The key has always been, Calm, Clear, Firm, Swift. They're now easy, even my second very spirited one. I have to take them with me everywhere I go, so there is no other option. They are the greatest kids, we have so much fun. Everyone says I'm so lucky they're so easy, they never need discipline...Yeah RIGHT! Now they don't need much, but it wasn't always that way.
You can do it. Dad being gone is hard, but you can still do it. Be sure dad steps up the discipline when he is home too and makes acceptable behavior VERY clear to your son. You're doing a great job already to have such great kids, just take charge of the 5 year old, he'll like you even better when he learns respect.
check out www.backtobasicsdiscipline.com