The biggest drawback to ginger is that it is also an antacid. This can adversely affect stomach acid levels, which is not a good thing since stomach acid serves a number of purposes.
People with nightshade sensitivities also need to avoid ginger as well as those on blood thinners.