Herpes outbreaks take a lot longer than 2 days to clear up.

In cold, hot weather my face and ears get very red.
Must have something to do with increased circulation.

My girlfriend gets sun rashes if she gets into the sun with no protection.
We were on vacation in the Caribbean one year and she had one of those whitehead outbreaks all over her back. We whent to the doc, I shelled out 60 American, he gave her a suave and all was good in a couple of days.

I think you just have a sensitivity to hot/cold exposure.