The "they won't want me after that" comment or whatever it was, I agree. Clearly a joke and I don't see an issue with that.
However, the comment about the speculation creating uncertainty with the players I thought was strange because irrespective of whether he thinks it contributed to the Pompey result, he did essentially admit that there has been some uncertainty. That uncertainty wouldn't exist if he had quashed the rumours, whether publicly or privately with the players. He also had the opportunity to shut it down at that point and he didn't. He could have said "there is no uncertainty in the group. They all know I am committed to the job at hand" or whatever.
This on the back of the comments he made after the Luton game - "for the time being" and "they can ring my agent".
He's had two chances to say he won't be going to West Brom and has failed to do it on both occasions, instead tiptoeing around it. Whatever the reasons for it, I don't think it is a good look from a manager who has done nothing more than a reasonable job in his time here.