xylitol might affect other good strains of bacteria. Xylitol effects the "adherence" ability of bacteria in general. Now (brand) might tell you that it doesnt kill the friendly bacteria, but it might make them less efficient. On Dr. Jeffs website type in xylitol in the search zone.
Erythritol can lower your blood sugar, I dont like this sugar alcohol. Made me tired.
Stevia is your best bet. Even that should probably be occasional use because it is still a sweetner and who knows what kind of sweet "chemicals" are in it that might feed candida to some degree.