My recommendations would for you to check your liver function out first. Ask for doc for an LFT, a liver function test (blood test), and I would also recommend that you complete a functional liver detox profile test, your naturopathic doctor should be able to organize this.
These two tests would be an intelligent approach, first see what state your liver is in, it can take a lot of guesswork out of the equation. Then you will be in a better position to be able to "fix what is broken" if it needs repairing. It sounds like a liver problem, and in most instances, it will be able to be corrected if it is.