The Red Devils have only kept one clean sheet in their seven games in all competitions this term and have conceded five goals in their last four matches.
Solskjaer has said that the team are "working on the cohesion" following Raphael Varane's arrival to play alongside club captain Harry Maguire in the middle of the defence, and the Man United manager is confident that their defensive record will improve over the next few weeks.
"It just shows the angle you're looking at and thinking, I'd rather score four or five or two and concede one than win 1-0. We're still working on the cohesion with Raphael coming in," Solskjaer told reporters.
"Work in progress, we want to have clean sheets to build performances from as well, we know we're going to score goals, hopefully I can answer at the weekend with a clean sheet but it is being moved on, of course."
Man United - third in the Premier League table with 13 points to show from their opening five matches - are back in league action at home to Aston Villa on Saturday afternoon.