The distilled water doesn't taste funny, your taster is off a bit. Once you get used to it and then go take a gulp of other water, spring, city, whatever, Then you'll notice a huge difference.
As your taster returns to normal other food starts tasting much better also. It's a neat thing to go through.