With a BS in Biology, I'll speak from a different point of view. I don't wear wool socks and Birkenstocks and hug trees. I just really wanted to be a doctor and love science as well.
Literally anything can be related to science. Yes, it's cool to do the things that blow-up, but it can be just as much fun to build rivers in our yards (buy a bag of river rocks at Lowe's, some sand, and a plastic box. Move rocks around while the hose is running and help him understand currents, etc). Go to the library and get Audobon field guides to things like birds, trees, fungus - I know it sounds geeky, but you can find things (leaves, bugs, etc) and look at the pictures to try to figure out what you've discovered.
Something like a frisbee will help him understand things like physics. Help him guess how far it will go. Same with bubbles - how many can you blow before the solution is gone.
Get chairs, step stools, etc. and play with gravity. See how long it takes for big vs. small objects to fall, heavy vs. light, wadded paper vs. flat paper, use water balloons to make it fun, etc.
One thing we're looking for to entertain kids at our son's birthday party next weekend (he's also 4 - today, actually) is a 3 person slingshot - get a small sling shot, find a boomerang, etc. and teach about distance, wind, lift, thrust (physics).
You can also take plastic water bottles, put oil in one part, water in another (color with food coloring) and show solubility. You can also shake them up and create tornadoes. Kind of fun.
You don't have to focus on chemistry. Seek ways to integrate other scientific disciplines (biology, zoology, physics) into the day.
There's also the Diet Coke and Mentos experiment if all else fails.
Good luck.