Elliott clearly had other thoughts because he first kicked out at Joe, then became involved in a fracas with Trevor Sinclair which led to his dismissal.
"He definitely contacted me and I feel it was definitely a penalty," says Joe.
"I have got a big bruise on the back of my calf if anyone wants to come and look at that, and that is because there was contact."
Although Elliott had earlier been booked for a foul on Trevor, because he received a straight red for the incident he will now be banned for the return fixture against the Hammers at upton Park on January 12th.
"It was one of those games where it was going to take something like that to get a goal; a bit of a wriggle in the box, or a bit of magic," adds Joe.
"I am not a diver, no way, I never will dive - there is no question about that."
Although Joe, prostrate on the ground following the foul, was unaware of what happened in the immediate aftermath - "I didn't see anything, so I don't have much comment on that," he says - he certainly enjoyed watching Paolo Di Canio's penalty.
"It was great confidence from him; that is just what you want in those situations."
As for the foul on Mustafa Izzet which saw him booked, he insists:
"I 100% thought I could get the ball - and that is what I was going for."