I hear you. I wish I knew when I was a kid that just swishing with oil would relieve those miserable tooth aches that you inevitably get on the weekend with no way to see a dentist.
I tried swishing with oregano oil previously and didn't like it. Partially because it was mixed with olive oil (making me gag) and partially because it did leave my mouth sensitive and burning afterwards. This time I just took oregano oil capsules and they seemed to do the trick.