It seems to me that this has already become an issue between the two of you. I can't see anything in your post that this will be less of an issue in the future - in fact, it will likely become more of one. From the tone of your message, it seems to me that you already know the wisest course of action. Trust your instincts but be open to working things out.
My advice (such as it may be) is to try to re-open the lines of communication. Be clear without being confrontational. Try to understand his viewpoint without dismissing it outright. Try to convey your own viewpoint and concerns without making him defensive. Very often such an expression may sound like an attack in a man's ears (even when it is not). Be aware of the same on your side. For this marriage to be a success, both of you will have to work for it and make compromises.