The clothing material or fragrance can cause just a reaction in lips. It is more a delayed reaction than immediate reaction like food, but if you often wear something you are allergic to, you will get the lip reaction on a regular basis. Even the fragrance in laundry detergent, shampoo, or shaving cream could affect you.