Unai Emery insists there remains room for improvement from his Arsenal side despite their comfortable Europa League win over Vorskla Potalva.
The Gunners raced into a four-goal lead as a Pierre-Emerick Aubameyang double, a Danny Welbeck header and a tap-in from substitute Mesut Ozil set them up for a big win.
But Vorskla rallied and halved the arrears as Volodymyr Chesnakov pulled one back before Vyacheslav Sharpar scored with the final kick of the evening as the opening Group E clash ended 4-2.
Emery made eight changes from the weekend win at Newcastle as goalkeeper Bernd Leno was handed his debut.
The Spaniard also gave fellow summer signings Stephan Lichtsteiner and Lucas Torreira their first starts but, despite marking his first European game in charge of Arsenal with a win, he was left with some frustration.
"It's our disappointment today," he said of the two goals. "Little by little we are conceding a few chances to the opposition, the same like in Newcastle.
"But we need to continue to improve on this because in the last minute in Newcastle and again today in the last 20 minutes, we conceded two goals.
"Our challenge is to be competitive for 90 minutes of each match and this is one thing to improve."
The late strikes also means that Arsenal are yet to keep a clean sheet in any of Emery's first five games.
"We are speaking before each match to take a mentality of 'don't concede chances easily'," he added.
"I think today is a good opportunity for not accepting goals, but the last 30 minutes, we needed to be better on this competitive aspect."
Vorskla coach Vasyl Sachko conceded his team were second-best but is hopeful they took some lessons from the game.
"We lost against a good team today, but it's good experience for us," he said.
"A few of the lads need to believe in themselves. Fate is what it is, and today's match shows us what we're aiming for.
"We stuck to our game plan for a long time, we were able to help each other out, the lads gave everything on the pitch.
"They knew that we couldn't open ourselves up, because Arsenal's attack is so quick."
ga('create', 'UA-72310761-1', 'auto', {'name': 'pacontentapi'});
ga('pacontentapi.set', 'referrer', location.origin);
ga('pacontentapi.set', 'dimension1', 'By Mark Mann-Bryans, Press Association Sport');
ga('pacontentapi.set', 'dimension2', '39911621-f8ab-4e76-82db-7279b73fddaa');
ga('pacontentapi.set', 'dimension3', 'paservice:sport,paservice:sport:club-news,paservice:sport:football,paservice:sport:match-reports,paservice:sport:uk,paservice:sport:world');
ga('pacontentapi.set', 'dimension6', 'story');
ga('pacontentapi.set', 'dimension7', 'composite');
ga('pacontentapi.set', 'dimension8', null);
ga('pacontentapi.set', 'dimension9', 'sport:football');
ga('pacontentapi.send', 'pageview', { 'location': location.href, 'page': (location.pathname + location.search + location.hash), 'title': 'Emery left disappointed as Arsenal concede more late goals'});