There's no way for anyone to know what it is, but if the doctor did a blood test and said that it's not herpes, then it's more than likely not. Perhaps a 2nd test will ease your mind.
Have you considered that it may be a food allergy ? Some people have latex allergies and there are some foods, like avocados, that have elements that are in latex in them and will cause people to break out when they come into contact with them.
Could be anything, but if you're really worried about herpes, get a 2nd opinion.