To get a better picture of what's going on, you need your Free T4, Free T3 and maybe RT3 to see if there is a conversion problem if your Free T4 is optimal.
Without thyroid meds (desiccated thyroid -- Erfa's Thyroid from Canada), my TSH is around 4.0. I began developing more and more hypo symptoms when I was in my 20's and was diagnosed with fibromyalgia instead because my TSH of 4 was "IN RANGE", so I couldn't possibly be hypo according to my idiot doctor!!!