I've heard of others with tooth darkening using olive oil. I'd stop that oil immediately. I found the white and brightening effects from walnut and apricot to be superior. I'd actually give those a try.
Others might have something to say about this too.