I'm proud of you too for sticking to your guns. It took one very horrible experience with my child to become firmly convinced she would never get another vaccine again. And thank God she lived and without the brain damage that usually follows an episode like she had.
One thing in which you can definitely follow this doctors advice though, seek another doctor. Of course you were already planning to do that:-)
There is a forum around here called Bad experiences with doctors, I think it would be good if you re-posted on it if you haven't already.
All the best to you and your baby.