Fighting candida is a cumulative thing. If I were to stop all supplements/antifungals/probiotics I take every time I tried a new one, it would take a lifetime for me to make any progress.
I have a steady routine of vitamins and supplements that I use. When I add a new one, I give it a bit of time and see how it makes me feel. If it seems to be working I keep it and incorporate it into my rotation; if it doesn't I don't buy it again. I think that makes a lot more sense than stopping 25 supplements every time you try a new one.