Perhaps the perfect caveat is the thalidomide solution.
Thalidomide was administered to many pregnant women in Europe to reduce effects such as morning sickness. Sadly, the results were disastrous with many thousands of deformed children as the results. The issue was and is that many children were born with absolutely not deformities.
It should always considered to be wise to err on the side of caution.