My doctors said the same thing to me and I was even referred to a psychiatrist who said I was suffering from olfactory delusions. I'm sure that maybe people do suffer from that mental illness but I know from the insults I have received from people that I am not delusional. I don't know what your situation is, but the best thing you can do is do some research on Olfactory reference syndrome and see if it does fit your symptoms.
I wish you all the best.
Free09