You need to be careful eating so much yogurt. A practitioner once advised me not to consume more than 8oz of yogurt a day but, at that point we were working on a mis-dx.
Have you tried a good probiotic?
The more you say, the more I suspect it's a GI motility or metabolism issue but, sure more qualified people will chime in eventually.
I believe any heavily restricted diet isn't sustainable long term.