A.M.
Panicking won't help anything, so try your best to breathe and relax a bit. I took Yaz for nearly 3 weeks while I was pregnant with my son. He is 7 now, with no ill effects :) You only took it for a few days, right? Your doctor can give you more info, of course, but I will tell you this- I know women who have taken all kinds of drugs before they knew they were pregnant and things turned out fine. You know now, you follow the "rules" now, that's the best anyone can do.
ETA : Based on the FDA warnings and clinical testing, I would not be worried if I were you. No human studies have found a link between Clomid taken during pregnancy and any issues with the pregnancy or fetus. It is category X because they have limited information, like most drugs and pregnancy. Don't take any more of course, but stop freaking out!