Oh honey just get it out. We have all had these symptoms, no one (in the mainstream medical community) believes it is the Mirena but it is. I had these symptoms for nearly the whole two years I had it in, they progressively got worse, and now it's been out for almost two months and I am 80-90% better. Many symptoms went away instantly (low back pain, bloating), some took a few days (weight gain), some took a few weeks (moodiness), some are lingering but much less severe and less frequent (debilitating fatigue, depression, moodiness).
I wish you the best. You know the answer to your dilemma in your heart. Follow it.