I.G.
Yeah, I have to chime in too. This is normal. My pediatrician doesn't want to see us until the fever is a 104 on Tylenol (not responding to medication) or if the fever lasts longer than 3 days. I am really happy with her laid back approach - it is not like they would actually DO anything for a 103.4 fever - other than sending you home with the advice to give Tylenol or Motrin.
If you want to switch, by all means do so, but your doctor gave pretty commonsense advice.
Good luck!