Zinc generally works really well for these. I recommend taking a 50mg zinc tablet and suck on it after eating a meal so the zinc will not make you nauseous. As the tablet dissolves swish the saliva around in the mouth to help coat the inside of the mouth with the zinc. Not the most pleasant taste, but the zinc will help kill bacteria and promote healing.
Increasing your intake of B vitamins can help as well.