Brendan Rodgers, Colin Pascoe and Joe Allen all left the Swans last summer to head for Anfield but Williams insists that the kind of thoughts behind that sit more with the fans than the players.
The Swans head to Anfield ahead of their opponents in the Premier League table and looking upwards at the European places as second season syndrome becomes nothing more than an urban myth in South Wales.
Victory on Sunday will push them past the magical 40 point barrier declared by many as enough for safety and into the League Cup Final a week later on a massive high.
“It’s a big game,” Williams told the Western Mail.
“It was important for us to get the win last week over QPR.
“And we’ll be looking to win again and set up to do that, but we know going to Anfield will always mean a very hard, tough game.
“Yes, there’s the fact Joey’s there and obviously Brendan is there so it’s going to be massive in that respect.
“But I wouldn’t say there’s a sentimental edge – that kind of thing’s more for the fans.
“It’ll probably always be like that and it’ll be the same when we play Wigan with Roberto (Martinez).
“But for us, we’ll just get on with it because it’s just another game and important in its own right. You have so many colleagues in this game that you’re always playing against someone that you know.
“And going to Anfield will always be a massive game in its own right, as it is any time you get to play at a stadium like that.
“We’re going to be up for it because it’s a big occasion.
“They’re doing really well at the moment,” said Williams.
“But I always knew they’d come good with Brendan in charge.
“It doesn’t surprise me that they are doing really well. It’s probably going to be one of the toughest matches we’ve played over the last two years.”
Williams was also asked about coming up against Luis Suarez again after his comments earlier on this season that he may have wanted to knock him out
“He’s going to start, he’s a good player and they’ve got Sturridge as well so it’s going to be tough defensively,” Williams said.
“I haven’t thought too much about Suarez, we’ve just enjoyed last week’s win and got on with our work.”