I don't have a retainer, so I can't speak from experience. But I have read some posts on this forum which were written by people who have said they removed their retainers and experienced relief from at least some of their symptoms.
I think you should strongly consider replacement (but, again, I can't speak from personal experience).