You really should get it looked at; but if it is affecting the inner labia, then could be internal abscess. That would cause a pressure pain. Try and keep a hot compress on there as much as possible, I guess. If it is internalized infection, it should break eventually.
This is a shot in the dark, and I am male, so best to wait until females think about this one. Shroom