Sodium Phosphate is not considered dangerous additive.
The worst problem with milk is that it is pasteurised and homogenized.
Up to 45ml of Sodium Phosphate is use to induce diarrhoea before surgery.
If used as food additive, amounts used are far below, not more then 1 - 2 ml per liter.