No Period but having PMS symptoms?

I had Mirena inserted in Feb. 2008 after having a baby in December. After 2-3 months of spotting I no longer have a period at all. I didn't notice any side effects initially however I started noticing an increase in anxiety over the past few months around the time I would expect to get a period. I had bad anxiety about a month ago. I went back to my doctor and he said it sounded like PMS and gave me Provera to make me start my period but I never did (and I'm not pregnant). I felt pretty normal until this past weekend when I started feeling anxious, cold, shaky, and sick to my stomach. The thing is this weekend was exactly one month from last time. I think it is something to do with the build-up of hormones and not having a period. Can anyone else relate to my experience? I never thought I would say I wanted to have a period but I think I would feel better if I could. I was on the pill for 5 years and never had any issues. My husband wants me to get it taken out that way we can rule out Mirena as a cause. I don't know what to do. Tweet