i had similar concerns at one time but i dont any more. there are hints that silver Iodide may have some benefit.
i took tons of silver before taking iodine. silver stays with you. so when Iodine came along i was taking 300mg of Lugols and not having any noticeable problem, silver related or not. silver can tax the liver. watch glutathione levels.