That's because your immune system doesn't have any defenses built up yet against this specific new invader. Once you've adapted to it and have the antibodies in place, it gets a lot better. The general wisdom is that it continues to get better with time for almost all symptomatic folks. Of course, the majority of infected people don't even know they have it since they don't have recognizable symptoms.
I've had it for about 10 years and haven't had an actual OB in several years. I keep famvir on hand in case I suspect something trying to get started. I take it for a couple days and that's the end of it. That happens maybe once or twice a year.