If I were in a relationship, and he wanted to go off for a weekend by himself, I would applaud it. If he wanted to spend a few hours playing golf or the like every week, I would applaud it.
On the other hand, I would not want to be alone every weekend, nor would I want to start feeling like a golf widow.
The key here, is "balance".
The key is also intimacy. To really be with someone when you are with them. To care about them and put their happiness on an equal par with yours (at least). Many people are together 24/7...but they are never together because they ignore each other. Quality is much more imporant then quanity, I think.