What if you helped him come before going to sleep? There's nothing more frustrating to a guy when he's lying next to his girlfriend in need of spilling seed and she ends up being not the least bit interested in sex.
I could understand the idea of not wanting to be disturbed while sleeping. I think I'd be annoyed if my girlfriend used my hands to spank the monkey her while I slept, just as much as if she turned on loud music while I was trying to sleep. Respecting another person's space is definitely a virtue, but whether the intrusion was sexual or not wouldn't make much of a difference.
Would your response to him have been the same if he decided to blast the TV while you were sleeping, or yak on the phone, for example?