It's hard to tell what is really going on, but so far you've admitted to the "joke" and "I guess me leading him on and him getting tired of it possibly made him think how HARD he is putting into this relationship and sees that he isnt gettomg any where with me."
So it's strange that later you say he "hurted" you; what's up with you? Either you're interested in him or not...if not, why lead him on? If you are, why the nasty remarks to someone you care about? You're suddenly so obsessed with something so small there must be more going on.
Sounds like you're right; he probably sees you now as a waste of time. Sounds like you haven't given him reason to think anything else. I'd determine my OWN motivation before continuing this relationship.