Hello:
I felt the same about my plastic bottle that came with my distiller.
I now put a large stainless steel pot beside my distiller to catch the water, then transer it to a glass jug after.
Hope this might be of help.
Blessing, Love & Peace,
Hippychick