"Will hardly" is a negative in the english language. Or, rather, it is an expression indicating that the speaker expects that something will not happen.
As in: I will hardly win the lottery = I won't win the lottery.
So, no it will NOT throw you back significantly. You'll feel bad for a day and that'll be the end of that.