I go along with all the advice you have already received on the use of the flannel. I did just want to mention that if you do accidentally get the oil on something that you didn't want it to get on, you can try washing with baking soda and it may get the stain out.
But otherwise, yeah... don't wash the flannel. Keep the oil in there.