Crystal Palace's Marouane Chamakh celebrates after scoring his team's second goal against West Brom during their FA Cup third round match on January 4, 2013 © Getty Images

Saido Berahino created the game's first chance when he dribbled into space just outside of the box, before unleashing a wild shot that flew over the crossbar and into the fans behind the goal.

Palace hit back almost immediately as Barry Bannan crashed an effort against the left post, having tried to convert from the edge of the six-yard box.

Matej Vydra looked to put the Baggies in front just after 15 minutes when the striker produced an effort with his right, but Julian Speroni was equal to it as he kept the ball away from danger.

However, it was Palace who drew first blood. Hiram Boateng fed Gayle outside of the area, allowing the striker to produce a left-footed shot that flew into the bottom-right corner to put the visitors 1-0 up.

Crystal Palace's Dwight Gayle is congratulated by teammates after scoring the opening goal against West Brom during their FA Cup third round match on January 4, 2013 © AFP

Yannick Bolasie almost put Tony Pulis and his men 2-0 ahead late on in the first half when he dropped his shoulder before letting fly with a right-footed effort that was kept out by Ben Foster.

Berahino sought to restore parity straight after the break with a shot from distance, although it did not trouble Speroni, who made a comfortable save.

Down at the other end, Bannan did well to get a free kick away from a tight angle, which almost troubled Foster who was caught scrambling.

Vydra was close again for the hosts in the 60th minute when he sent a stinging effort towards goal, although Speroni did well to make a diving save down low at the bottom-right hand corner of his goal.

West Brom's Matej Vydra and Crystal Palace's Hiram Boateng in action during their FA Cup third round match on January 4, 2013 © Getty Images

English youngster Berahino looked like he might be West Brom's best chance of getting back into the match and he continued to pepper the goal with shots from distance, with his effort in the 70th minute forcing a good save from the Palace keeper.

Substitute Stephane Sessegnon did his best to try to force the issue following his introduction, but the striker's best efforts both came from distance, with Speroni getting behind them with ease.

Palace completed the victory in the final seconds of the match as Chamakh converted from only a few yards out to leave the final score at 2-0.