First of all it great that you seem to have terrific attitude towards your own age just seems your'e at a good place with yourself.
Now here's my advice DONT go out with him simply out of pity you wont be doing either of you a favor.With him of you go out with him out of pity and you know u dnt like him then ur wasting his time its better his feelings now than playing with his feelings.As for you, you feel pity for him go out with him becareful of getting caught up in a game where you were hesitant then just went along with it just to or out of pity but the u later end up being caught up then getting hurt you know that when men decide they rarely ever have this pity thing like us so dont do things out of pity.
However it looks to me like a part of you is curious well the hide and seek games wont cut it.You wont loose anything to satisfy your curiosity and just hang out with him and figure out what he's about.Next time he comes to the restaurant apologise that your'e busy you dont mran to cut him off rather if he'd like heres your card he shold call you when your'e not busy.Just have fun the whole thing about COMMITMENT PHOBIA is what your'e doing prejudging and deliberating on what will happen and why it wont work.In your head youv'e already worked out the logistics but try to just let things work themseles out and if anything you might get a freind out of it.Keep us posted