Are you using a condom? Try that and see if that makes a difference. The sperm/semen may have the candida and then it is in you. I have read that candida is transmitted sexually.
If you are using a condom, then I am not sure.
Can candida be spread orally? If you are performing oral sex, I would assume it could be as the bodily fluids are entering the mouth.