Last weekend's defeat to Manchester United was the club's first of the season, which was followed by a nervy penalty shoot-out win over Fulham in the Carling Cup third round.
The Serbian defender is likely to partner John Terry at the heart of defence on Saturday, and says the club must get back to winning ways.
"I think it's important for us now to win every game," Ivanovic said. "It was difficult because it was the first loss of the season but sometimes you have to look at the good side, and after losing a big game you know you have to win the next one.
"It's never good to lose but when you do, you can grow and learn more from losing a game than from winning a game. Everyone knows we need a good reaction and to show that in the next game. It is a long season and we don't need to think more about that game, we know what we need to do and we are looking forward."
Alex's suspension, following his red card against Fulham, means Andre Villas-Boas will be forced to alter his back four yet again, a defence that had kept one clean sheet in it's previous nine league matches.
"The defenders cannot be happy about this," Ivanovic added. "Last year we had the strongest defence in the Premier League, but in football this happens sometimes, and I don't think we are less strong in defence than before."
"We will just have to work hard and improve, and it is all of the team, everyone together wanting a clean sheet.
"We play more offensively under the new manager but this should not mean we are more open in the defence because everyone in the team knows what we need to do and what the rules are.
"For every defender a clean sheet is important for confidence and we can improve this, but more than that now we just need to win the points over the next few weeks and stay close to the top."