Candida symptoms/die off PLEASE HELP!!

Ok so I will try to make this as short as possible. I have been feeling horrible for over a year now, and I am just looking to get some relief. I used to take Antibiotics as a child and as an adult as well and I believe this is what caused my problem with candida. The issue is I am not 100% certain I have it. The only proof I have is a holistic doctor telling me that because of my past use of the Antibiotics and oral thrush and other symptoms I most likely do have an overgrowth. I changed my diet last week and my symptoms have got worse! I am guessing this is the "die off" but is it possible to experience die off with only a diet change? And I have cheated a little on the diet too. Here are my symptoms for over a year:
Oral thrush
Hair loss
Severe brain fog
Memory loss
Slight depression
Weakness and fatigue
Insomnia
Sagging facial skin
Anxiety & Panic attacks
Blurry vision
Vertigo
Acne and scalp/neck sores
food allergies to everything except meat and vegetables

I'm sure there is more but I am having the worst brain fog the past four days it's hard to remember all my symptoms. I am just wondering are these symptoms of candida and is it possible to experience die off so quick from just changing the diet? I am currently taking milk thistle and a combo of zinc calcium and magnesium. Any remedies for brain fog/symptoms is appreciated as well!!