SOunds like a masked allergy response. You become tolerant of things that you are allergic/intolerant of.
When you remove them from your diet you lose the resistance.
How often do you hear someone who has given up alcohol or reduce an amount substancially say they get drunk really easily now.
You body has adapted and now when it shouts at you it doesn't sound like a whisper and get drowned out anymore.