I think you should stop and see if it improves. If not, then you may want to consider going to see a doctor. Might be nothing more than an irritation, might be something more.
PS. Experiences like these are stark reminders of why I prefer to make my own CS above all things. As we just never know the processes and ingredients used in purchased solutions.