Lemon juice is said to be good for dissolving kidney stones. At least this would work for uric acid stones due to the malic acid in lemons. Not so sure about calcium oxalate stones and some other forms of kidney stones though.
And there are better sources of malic acid such as green apples, apple cider vinegar and tart cherries.
Olive oil is not going to have any effect on the kidney stones.