I suppose damage is a possibility, but then again it may not be nearly as bad as you are afraid it is.
Do you have any inflammation/swelling/discomfort?
It could well be that your ear canals are swollen and you also could have a bit of liquid remaining behind. When either or both of those occur you can have markedly reduced hearing. That has happened to me - in fact, I am going through it again right now. They may clear up in time. Though I am hesitant to recommend putting anything else in your ear, often a couple of drops of rubbing alcohol will help get rid of remaining liquic.
Someday, it may be a good idea to visit a professional and see about having a procedure to get rid of ear wax.. That stuff can accumulate and harden and slowly diminish your hearing. I have had that done a few times in the past and was always amazed at all the gunk that came out as well as how much better my hearing suddenly was.