While I do not have any moral objections to pot smoking, I do avoid my friends that do smoke it. I have a job that pays me good and I do have to submit to a drug test randomly. I have gone over a year without a drug test and I have had them weekly for three weeks. I cannot afford to breathe the same air where pot is fired up.
While I do hate to leave when they fire one up, I do have a family that depends on me for support. Only I can decide my priorities. You have to decide yours. It's your call.