You are not crazy! Though my symptoms varied from yours in many ways, I can tell you that my night sweats were directly related to the Mirena. I would wake up with massive anxiety feelings, heart pounding, and my sheets, pillows, and pajamas soaked once or twice a night -- which was very disturbing since I'm only in my twenties and not expecting menopause for quite awhile! It's been removed for exactly 4 months now and I only get an occasional night sweat once or twice around my period, and they are not as severe as when i had the Mirena in.
Many posters here have many of the symptoms you described. I would not hesitate to have the Mirena removed. I feel like reading posts and validation from this community and having mine out has saved my sanity if not my life : )