Newcastle and Liverpool are level at half time after a first half that saw the home side finish with 10 men.
Midway through the half, the hosts took the lead thanks to Yohan Cabaye's surging run into the Liverpool half unchallenged, before unleashing a looping shot which keeper Simon Mignolet couldn't deal with.
Luis Suarez tried to manufacture an opening almost instantly as he took an overhit cross before picking out Mahmadou Sakho, who couldn't keep his header down.
The visitors struggled to get a foothold in the game as the Magpies looked the more likely to score.
However, just before half time Suarez found himself bearing down on goal only for Mapou Yanga-Mbiwa to pull him down.
Referee Andre Marriner didn't hesitate in sending off the full-back despite the protestations of the Newcastle player, and Steven Gerrard put his spot kick in the bottom corner of Tim Krul's net.
Liverpool started the game level on points with Arsenal at the top of the table.