Not a good idea. Would you like it if your husband did the same.
Besides he asked you, would you ever have thought of asking him.
Of course often people go out for business lunches etc, but the one on one meetings not related to business often create problems in the long run. It is always better to not put yourself in that position.
It is only good for the ego.
Every affair starts with an innocent encounter.