You should follow the anti-yeast diet more strictly. That would likely help you feel better in the short run.
I would definitely recommend that you do research in the direction of heavy metal toxicity since you have a number of classic metals symptoms. There are a lot of mystery sources of heavy metals, so the fact that you have never had silver fillings doesn't prove that this isn't your trouble.
Be skeptical of any heavy metals tests since they aren't known for being very accurate. There are a lot of people who tested negative, then chelated anyway and saw their health improve.