I know what you mean. I get real tired of having to explain myself though. My husband knows pretty well what I can/can't eat and lets others know so they can keep my diet in mind.
They blame my thin-ness on not eating meat; I should become a carnivore so I can gain some weight back. I also live in a State (Texas) where meat is an important food item. Barbeque is very popular.
Most people do like my dishes and I like to surprise them with dishes that have hidden tofu in it, just so I can say: so, you just ate tofu, and it didn't kill you! What do you think of that? And it usually does surprise them in a good way.