They are too stimulatory for you because your body can't clear them.
As I said earlier the body clears adaptogens just like it clears foods and supplements like vitamin C and B5. So inability to clear adaptogen metabolites has NOTHING to do with the stimulatory effect.
Some adaptogens such as Panax ginseng, Rhodiola rosea (Arctic root) and American (not Chinese) licorice root are stimulants.
People can react to the non-stimulant due to allergies to the herbs. Allergies are more common in those with adrenal dysfunction. When people are exposed to allergens epinephrine (adrenaline) is released from the adrenals as part of the body's defense against the allergic response. The more severe the reaction the more epinephrine the adrenals will try to release. Epinephrine is a powerful stimulant.