first thing is.. dont be hard on yourself.... none of us are perfect. i am allergic to wheat and gluten too... and i have little slip ups when i get frustrated by all the limitations...
Just keep doing the cleanses.. be extra easy on your system for a couple days.. maybe do a flush and things should be back to normal soon!