Maybe - try a pinch, this shouldn't be a big deal, compared to all you are getting eventually from the pipes. Let us know if it works. You may test with pH paper. Unfortunately most of the contaminants will remain in it. It is worth buying a home water distiller, when possible.
PS
I believe, boiling the water concentrates the contaminants. It may get rid of some chlorine or fluoride, though.
Take care
DL