Just letting you know you are not alone and that my symptoms started about a year after getting it....just after I weaned my son and coincided with the return of my cycle. I have had it out for 6 months now and although not 100% I am about 80% there and continuing to improve (I hope).
I would definitely say get it out and let your body rebalance.
Best of luck and I hope you dont feel alone, hopeless or crazy (I certainly did for a while), you will improve!