You are the only one who can answer this question. It is up to you to decide what your limits are. IF you have already surpassed those limits, then YES you need to do something else. IF your physical safety is in question then there should be no doubt what you need to do.
Relationships are tough, no one ever said they would be easy. Well that is unless you are into Romance novels. ( I personally can stand the stuff and think that some readers have a hard time remembering that its a book and not real life.)
You mention that he has medical reasons, and that the two of you were going through finals... sounds like stress to me. Add to that feelings, or a desire for you to leave, and you have a very volatile situation. Whether you realize it or not, I am sure that even before you TOLD your boyfriend that you were thinking of moving out, you were broadcasting these feelings. It can be simple things, but enough will add even more to his stress as it does to yours. Why people think that hiding their feelings will make it that much easier, is beyond me. WOMEN, guys pick up on these things.
There also sounds, at least to me, that there is a co-dependancy issue here. If you do decide to get out, you need to seek help. It maybe difficult for you to turn to another friend, and I highly reccommend not turning to a guy friend right away. I cannot tell you the number of times I have seen guys and girls turn to friends of the opposite sex for understanding and confidence, only to end up thrusting themselves into another relationship that neither of them intended to have in the first place, and is trully not founded on anything. Most of us call it rebounding, and trust me, from some one who has done it enough times, you never realize what you are doing until it is too late. So just don't go there... seek out a counselor. You are a college student, or were, the university has counselors availible to you. They may even be able to get you into a support group for co-dependant people.
I wish you the best of luck. It won't be easy, but you have taken the first step in seeking help from the outside. You are obvioulsy a very inteligent young lady. Follow through with what ever you decide to do.