You just explained how I feel. Almost identically.
For the same reasons I'd rather not talk to people and have them angry or questioning why am I so weird than trying to talk to them and have those reactions like you described.
We won't give up. We'll get to the bottom of this sooner or later! :)