SoulfulSurvivor --- You so eloquently explained how things are currently going for you.
Reading through your post, it is plain to see that you are on the right track. Keeping a journal is an excellent idea. That way when you meet with his therapist, you will have a written record of your thoughts and feelings. Much as we say to ourselves, "I will remember all this when it's time to discuss the matter", we often realize that we forgot a crucial topic that we wanted to discuss.
Whatever you end up deciding to do, please know that you continue to be in my thoughts. Sending more hugs your way!