I've had very fatty breakfasts and lunches (ending at 2:00 PM) with good results.
Believe it or not, bile rejuvenates itself fairly quickly between meals. If you're not taking the OO (Olive-Oil) until 10:00 PM, I imagine that you will be fine.
If you're one of those who only gets 20-30 stones per cleanse, I wouldn't be as sure, but I'd still say go ahead and try it.