Actually, your story is good. One thing is for sure, he might have been attracted to you, may be through the way you attended to him as regards office setting and moral background. He was trying to appreciate you off the office setting. He really knows exactly what he was doing and never told you anything.
It is left for you to know him even before deciding to go out with him from the first day. Ask him (them) questions, so that you don't misinterpret the men that would lead to their giving you a funny name.
I advise you be mindful of your actions and inactions in their presence as a young lady.