I have rescued and doctored many, many stray and feral cats, which resulted in lots of scratches... At least 20 cats. My arms are covered in thin cat scratch scars. Lol. (On the plus side, once they were doctored up and socialized, most of them were re-homed happily.)
I have never had any ill effects. I cleaned the scratches thoroughly with soap and water, and used whatever ointment I had at the time. (I like bactine)
I would be worried about the fact that the cat acted so aggressively... If it actually charged at you, with the purpose of attacking you... Unless it had kittens or something nearby, that is VERY unusual behavior. Usually, a scared cat will puff up, hiss, and back away.
Keep an eye on the scratches, and keep treating them. If they get swollen, pussy, bruised, etc. I would see a doctor. Also if you get headachy, a fever, or flu-like symptoms.
Ha ha, didn't notice you said one was bruised and puffy... I would get it looked at.