Don't worry. I've been on a paleo diet for a while now. When I eat a handful of carrots, a few minutes later I'm completely out of it, exhausted. When I eat eggs or dairy products containing vitamin a, I get the exhaustion and everything else (joint pain and stiffness, dry skin).
I'm not sure what path I need to take to fix this. Sine I've been taking liver detox supplements, I've been feeling a bit better. I've also heard of many stories of Accutane sufferers doing colonics and Liver Flushes to rehabilitate themselves.