Soy can make your hormones go crazy, male or female. Actually it has a lot of problems, should be okay if you're not having a lot, but if you are having a big serving everyday, then I'd research it first. But it doesn't mean whey is that much better.
Downside to large amounts of protein is damage to kidneys and liver. And heart/cardiovascular disease.