Office ual harrasement?

I had a male co-worker make crud comments in the past. The time before last we were joking about his age and he had forgotten something. I said oh, you are showing your age, your grey hair. Just laughing. He says, well, don't let the grey hair fool you, my other package works just fine. I said, ew, didn't need to know that, didn't want to know that, it needs to stop. I don't like it. He did good for a while. Staying polite and professional. Well, last week, he come to my desk. Sees a flier that reads, Public Open House. He says out loud, Pubic Open House. I flipped. I was like, what? I told him I don't appreciate that talk, I've told you in the past, but this time, you've gone too far. I don't like it, it needs to stop. His reply was scarcastically, "so". I told him, "you're a perverted old fart, get the hell out of my face. He did. He came back later, I avoided him. Apparently he wanted to apologize. Ended up going to h.r. filing report, etc.. They speak to him. My supervisor, myself and h.r. meet. He was spoken to. Told not to speak to me anymore, only work related. I said that was fine. He conveniently did not recall the past incident. (mental note.. lesson learned, turn them in the first time it happens!!) Then the kicker was, I was told, ok, now we need to discuss the way you spoke to him. You were unprofessional and the words were not called for. I said, really? Well, I did EXACTLY what I was taught in ual harrement cles. We are supposed to tell the person, don't like it, stop it. I did that the first time and I unfortunarlty had to say it a second time. Which went to proove that he doesnt' care because he said "SO". That's when I had to go down to a level that he would understand. He sure did! He comprehended then what I meant. I was told, well, you shouldn't have stooped to his level. I said, you are right. I shouldn't have had to, because NONE OF THIS SHOULD HAVE HAPPENED. It's sad that it took me saying, That how you should be seeing it. It's sad to make someone comprehend what you are saying by saying it in laymen terms, to get the message across. Pretty sad.