Work / metrics and service quality

LISTENING • C1 ADVANCED • MAIN ARGUMENT

What the Dashboard Missed

Listen to Adrian interviewing Elise, a customer-service manager at an equipment-hire company. Choose the best answer, A, B or C, for each question.

Overall meaningEvidenceService quality

1. What is Elise’s central point?

2. What is Adrian’s main contribution to the discussion?

3. Which approach does Elise favour at the end?

Work / metrics and service quality

LISTENING • C1 ADVANCED • FILL THE GAPS

What the Dashboard Missed

Listen again. Type ONE TO THREE WORDS from the recording. Questions follow the order of the interview.

Exact wordsSupporting detailsListening for information

Work / metrics and service quality

LISTENING • C1 ADVANCED • ARGUMENT MAP

What the Dashboard Missed

Complete the argument map. Match each role in Elise’s explanation to a statement A–H. The roles are mixed. Use each statement once; one statement is extra.

Claims and evidenceQualificationsAlternative explanations

Statements

A. A quicker recorded first reply was treated as evidence that customers were being helped more effectively.

B. A customer received prompt acknowledgements but still had to contact the company repeatedly about a delivery change.

C. New messages about the same unresolved issue appeared as separate short cases.

D. Simple enquiries really did benefit from faster, useful replies.

E. The before-and-after figures alone could not separate the new process from other changes.

F. The second period included fewer complicated enquiries after the busiest season ended.

G. Response speed should be considered alongside evidence that the customer’s problem has been resolved.

H. A single measure should be replaced by one score combining every aspect of the service.

Work / metrics and service quality

LISTENING • C1 ADVANCED • TRANSCRIPT

What the Dashboard Missed

C1 Advanced • 2 speakers • Transcription

Performance measuresEvidenceCausal claims

Adrian

Elise, your customer-service dashboard showed a substantial improvement after you changed the way enquiries were handled. Yet you’ve said the figures made you more cautious rather than more confident. What did you see at first?

Elise

We hire out equipment for local events, so people often need a fairly quick answer. The average time to a first reply fell from roughly twelve hours to under three. I took that as evidence that we were helping people more effectively. It was a reasonable place to start looking, but a rather premature place to stop.

Adrian

What exactly counted as a first reply? Was somebody dealing with the question, or simply confirming that it had arrived?

Elise

Either could count. For many messages, we introduced an automated standard reply. Other enquiries went straight to a member of staff. The acknowledgement was useful: people knew we’d received their message. But the dashboard put that receipt beside a reply which actually solved a problem, as though the two told us the same thing.

Adrian

Couldn’t you look further down the record and see how long the customer waited for a useful answer?

Elise

Sometimes. The complication was that a customer could send another message and receive a new case number. That second message might concern exactly the same issue, but it appeared as a new case with its own quick first response. You could have several records looking quite healthy while the person behind them was still waiting.

Adrian

Was there a particular case that made the distinction difficult to ignore?

Elise

A customer wanted to change a delivery window. She received three prompt acknowledgements over two days. What she needed to know was whether the equipment would arrive when somebody could receive it. None of those messages told her. In the end, a colleague phoned her and sorted it out. If you looked only at the first replies, there was very little to explain her frustration.

Adrian

That’s a striking example, but does it justify questioning the overall improvement? There could still have been plenty of customers getting useful answers faster.

Elise

There were. Questions about collection times or where to return equipment often received a clear answer much sooner. I wouldn’t want to lose that. The delivery case didn’t prove the whole process was failing. It showed that our broad interpretation of the figure needed checking. Both the genuine improvement and the unresolved problem could be present together.

Adrian

Did the way the results were presented encourage that broad interpretation?

Elise

In the weekly report, those short cases appeared separately. The customer’s effort to connect them wasn’t visible. Nothing in the report was necessarily false; it was organised around our units of work. We’d quietly assumed that improving those units meant improving the experience they were supposed to support. That link was precisely what we hadn’t established.

Adrian

And what else changed between the two periods? If the second set of enquiries was easier, that might matter as much as the process.

Elise

The busiest part of our season had ended. We were getting fewer complicated enquiries involving several deliveries and last-minute changes. So yes, the mix of work was different. That doesn’t establish how much of the improvement came from the quieter period, but it gives us another explanation we can’t simply leave out.

Adrian

Did you have a way of separating those influences, rather than comparing one month with the next?

Elise

We didn’t have a comparison group. The before-and-after figures showed a change, but they didn’t isolate its cause. I could say the new process was in place when the number improved. I couldn’t honestly say the figures demonstrated that it caused the whole improvement. That’s a narrower claim, but a more useful one for deciding what to keep.

Adrian

Would collecting a wider range of information solve the problem, then? Or do you just end up with a bigger dashboard and the same uncertainty?

Elise

You could. More measures don’t automatically produce a better explanation. I’m not looking for one replacement score that combines everything and tells us whether we’ve succeeded. I want us to be able to ask whether faster responses went with resolved problems, and to examine cases where those things moved in different directions.

Adrian

So what would you put beside the response-time figure now?

Elise

I’d examine repeat contacts about the same unresolved issue, and check a sample of the actual exchanges. A second message might be a useful new question, so even that count needs context. Keep the speed measure, certainly. Just don’t let the fact that it’s easy to display make it the final answer to a question it was never designed to answer.