I've dealt with a number of abscesses over the years with two steps:
1) oil pulling twice a day with my preferred oil and as many drops of oregano oil added as I can comfortably handle. (usually 4-5 but it depends on the strength of the oregano oil).
2) Swish around liquid Bentonite clay in my mouth for as long as practical. This will draw out the infection (and pain) even faster and is a great one two punch.
After the infection is gone, keep up with the oil pulling daily as a maintenance adding in the oregano oil once a week or so.