Oil is just food. It won't hurt at all. Actually the EFA's you could be absorbing will be excellent, as well as removing bacteria from your oral cavity that can be swallowed or absorbed into your system.
I actually think that OP is an excellent breast feeding tool. Wish I'd know about it when I was breast feeding my son.
Congrats on the baby. Mine is 17 and I miss that time so much.