Diflucan and die off

Hi, I've been going through the ups and downs of Candida overgrowth for the past 12 years. What seems to happen is once a year (after a couple of months of cheating on the diet) I get panic attacks followed by Depression for about 2 weeks. This has just happened to me again and I went to the doc. and got a script for Diflucan. I remembered from 2 years ago when I took it for the first time (100mg tab) and got horrible die off reaction (really bad cold shaking, panic attacks, depression). So this time I decided to take it slowly by starting with 1/8 tab, then 1/4, 1/2, etc... I took the 1/8 for 2 days with minor die off (same symptoms as before). 1/4 for 1 day (seemed ok), then yesterday I took half and I've been freaking out since then. I've also been recommended to take vit. C (2000mg) and vit. B (1000mg). The question I have is am I going to be OK by not taking the whole Diflucan dosage right now? If I take a whole one I think Id end up in the hospital. I also know it's working on my tongue (for the last 2 weeks it's been very coated with nasty white stuff now its only coated on it's back). Any input here would be extremely appreciated.
Thanks
Joe