My husband developed this in his 50's! So I guess the answer is yes, you can just develop an intolerance. All I can say is give it a try. If it works, it will be worth giving up dairy. If it doesn't, then your intolerance is to something else. It is one of those things that the results are immediate. Stop for a day or two and you will know.