Nigel Pearson's second stint in charge of Leicester City began with a win thanks to second-half goals from Jermaine Beckford and Paul Gallagher.
Both of Gallagher's strikes, scored within three minutes of each other, were stunning efforts from distance.
After a goalless first period of few chances the Foxes took the lead ten minutes into the second half.
Paul Konchesky travelled well down the left before Richie Wellens laid in Beckford to slide home from inside the area.
Gallagher then took centre stage 15 minutes later. First he curled home from long range before another 35-yard effort, which Julian Speroni between the sticks could do little about.
The home side jump five places to eighth while Dougie Freedman's Palace continue their slide down the table and are now ninth.