If you're craving and eating a certain food or food group frequently, and perhaps feel addicted to that type of food, then you could be intolerant to it. I've read studies by nutritionists who noted that people with food allergies /intolerances tend to binge on the very foods that cause them problems. When those people are instructed to eat anything EXCEPT the suspected allergen(s), they often stopped bingeing altogether. See this page for further reading:
Wheat and dairy products have this effect on me. I get a 'high' when I eat them, and when I abstain, I get strong cravings and withdrawal symptoms. They also make me gain weight disproportionately to the calories they contain, whereas weight just falls off me when I don't eat them. I really recommend you look into this - it could be the cause of your problems too!