The £3.2 million summer signing from Birmingham City scored the only goal of his side's 1-0 victory over Southampton at Carrow Road, firing low past Artur Boruc in the 68th minute. The visitors' Adam Lallana hit a post in the first half.
Jermaine Pennant netted for the first time in 63 matches to give Stoke City a 1-0 success at West Ham. The substitute struck with a 25-yard free-kick in the 82nd minute.
Newcastle United edged past Fulham 1-0 at St James' Park thanks to Hatem Ben Arfa scoring their first goal of the season after 86 minutes.
Yohan Cabaye came off the bench for his first appearance of the season despite his future remaining uncertain, with Newcastle having turned down a £10million offer from Arsenal.
Cardiff City held visitors Everton to a 0-0 draw, the Goodison Park side having been denied what appeared to be a clear penalty in the first half when Leighton Baines was brought down by Gary Medel.
Crystal Palace got off the mark with a 3-1 win over Sunderland. Danny Gabbidon opened the scoring at Selhurst Park, with Steven Fletcher equalising after 64 minutes.
However, John O'Shea was sent off for hacking down Palace striker Dwight Gayle after 79 minutes. Gayle stroked home the penalty and Stuart O'Keefe made it 3-1 in injury time.