Norwich fought back, though, as the in-form Teemu Pukki made it five goals in his first three Premier League appearances to level matters again on the half-hour mark, only for Abraham to win it with his second goal midway through the second half.
But Norwich equalised just 156 seconds later, Todd Cantwell finishing from close range from a Teemu Pukki cross.
Lampard, whose third child was born a year ago, had not managed a win in his first three games in charge but has no grand plans to celebrate his maiden victory.
"If celebration means a couple of glasses of wine while watching the baby monitor this evening and watching Match of the Day, then that will be it". That's the way life is these days!
"The two goals we gave away I didn't like but there were lots of good elements to our play and i'm really pleased".
Apparently you can win Premier League games with kids.
"I didn't want a slow start". So it changes it for me, today. "Obviously I was happy for the team because they'd won and for him as well", he told Chelseafc.com. "I was smiling so much", Odoi added.
"We will assess that over the next 24 hours to see if he is fit".
Dwayne Johnson is Forbes' highest paid male actor in the world
And being named the highest earner in Tinseltown is hardly the only thing Johnson has to celebrate these days. Dwayne Johnson just claimed the top spot as the highest paid male actor for the second time in a row.
Frank Lampard has endured a frustrating start to life as Chelsea manager with the former midfielder suffering a thumping 4-0 defeat to Manchester United on the opening weekend before seeing his side held to a 1-1 draw at home to Leicester last time out.
In the absence of N'Golo Kante, Frank Lampard could bring on Brazil global Willian as Chelsea search for their first Premier League victory this term.
Mount spent a year ago with Lampard at Derby and the manager was pleased to see both his proteges on the scoresheet.
He recently returned to training with the first team, and the teenager insisted that, should he get himself on the score sheet soon, he would not hesitate to celebrate with a ball boy.
"They are not necessarily local boys, not in the modern way of football because players are from all over the world".
Ben Godfrey nearly rescued a point when he headed against the crossbar, with Farke ruing the defending for Abraham's victor.
"You think, "Can I become like him or at least get to the top where he is?" and I'm now fulfilling that dream", he said.
"I would also expect the same of my players, so I don't accuse them". They had spells, we had spells.
If there's one thing we've learned from Norwich's opening three games it's that if they do indeed stay in the Premier League, they're going to do so playing their way.