That's actually GOOD to give your body a week's rest from working out. I was following a plan several years ago that involved heavy, intense workouts for 12 weeks with a week in between to rest. Now I no longer follow the program but still workout 5 days a week ,and at times, will give my body a week's rest to recuperate. Plus, it sounds like you are doing some lifting at work so you still getting some workout even though its not a "workout".
Okay - so next week hit that gym equipment! (chuckling!)