I have also found that many foods taste very sweet - but I mostly notice it with thing like Beets, Carrots, Yams and a few others. These have a fairly high glycemic index so it might explain the sweetness :) I don't believe they would be a problem.
I had removed a lot of things from my diet in the beginning which was actually worst for me. I have been doing much better eating reasonable amounts of "sweet" vegetables - athough I still do stay away from fruits - except Lemons/Limes.