They say some people's immune systems fight off certain worms. I read a study that 80% of people self-cure of Ascaris, which the other 20% don't. They have found genetic predisposition to be infected with worms in families.
I suspect it could also be order of infection. Like maybe I got one worm that my body ignored for a long time and kind of fought it. But then worm 2 comes along and I have no resistance at all, because my immune system is all wrapped up trying to keep Worm 1 at bay. So I think the older you are, the longer you have had time to "collect" this stuff, the worse it can be. But for those with poor immune systems (kids and immune compromised) it can be even worse with just one infection. That is my guess. It is just speculation.