Yea, it might have an effect for some people, for others it might not. It would be great if what worked for someone here would work for everybody (like leaving them alone), but that's not going to happen. Everyone has to try things on their own.
I will try to keep my gluten and dairy free diet up for a month or two and see if that changes anything (I was planning on doing the leave them alone treatment for another two months anyway and probably quit if I don't see any progress whatsoever).