I am wondering if it is possible to replace the plastic container with a glass one-perhaps something like the glass pitcher used for a coffee maker. I'm thinking maybe it will splash all over the place as the plastic pitcher included with the unit appears to be enclosed.
Here's what I do and I have almost the exact same distiller. I let the water collect in the plastic container and once the distilling cycle is over I immediately transfer to glass "beer growlers". They hold 64 ounces. I can't imagine having the water sit in the plastic container for 4 hours doing any harm.
I think that kind of plastic has BPA which leeches out with heat. I wouldn't collect it in that plastic. (If the recycling code on it is 7, get rid of it!)