Performance Reporting Measures vs Performance Management Measures
29/11/2019
![Screenshot 2019-11-29 at 15.01.51](https://blogs.cranfield.ac.uk/wp-content/uploads/2019/11/Screenshot-2019-11-29-at-15.01.51-1.png)
You may have read my blog from last week about A&E Wait Times. We indicated that the way these kinds of figures are reported, out of context, is hopeless in actually understanding what is going on.
But the problem doesn’t stop there. There is a fundamental problem with performance reporting, and the measures you see being utilised there, versus performance management and the measures being utilised here!
Let me explain.
Performance management requires you to understand the behaviour of business processes and make interventions to improve them. This implies that you use a small set of specific measures that we’ve blogged about before – see previous bloghttps://blogs.cranfield.ac.uk/leadership-management/cbp/the-future-of-operational-performance-management-part-3
For example, these performance management measures would include number of items coming into a process, number leaving a process, throughput time and so on.
Performance reporting is littered with measures that may appear to carry meaning for some people, but in our observations, have been misleading and impenetrable to many. And certainly don’t help understanding nor how to improve!
Here are some examples of reporting measures:
- % items completed: % implies a ratio – with a numerator and denominator. E.g. % Repairs Completed defined by (Number of Repairs Completed / Total Number of Repair Calls) * 100
- % completed within some timeframe: E.g. From last week’s A&E Figures, we saw % A&E attendants seen in 4 hours or under.
- Complicated Measure Combinations: E.g. % Forecast Accuracy in Supply-chain
- Applying sophisticated statistical treatment to raw performance measures that only stats specialists can read: E.g. Exponentially weighted moving averages
- Statistical representation of a population of people or things: E.g. Electric Car Use by Country
In today’s blog, we’ll look at why %’s are a problem (the argument is exactly the same for ratios) in trying to understand what is going on?
- % Repairs Completed: Let’s assume more is good and less is bad. Here’s how complicated we have made it to understand what is going on (see yellow box):
- % Repairs Completed has gone up (since it was last reported on). There are five different combinations of Number of Repairs Completed vs Total Number of Repair Calls:
i. Number of Repairs Completed has increased; Total Number of Repair Calls stays the same
ii. Number of Repairs Completed has increased; Total Number of Repair Calls increases, but at a slower rate
iii. Number of Repairs Completed has increased; Total Number of Repair Calls has decreased
iv. Number of Repairs Completed stays the same; Total Number of Repair Calls has decreased
v. Number of Repairs Completed has decreased; Total Number of Repair Calls decreases, but at a faster rate
- % Repairs Completed remains the same (since it was last reported on). There are three combinations of Number of Repairs Completed vs Total Number of Repair Calls:
i. Number of Repairs Completed has increased; Total Number of Repair Calls also increases at the same rate
ii. Number of Repairs Competed stays the same; Total Number of Repair Calls also stays the same
iii. Number of Repairs Completed has decreased; Total Number of Repair Calls also decreases at the same rate
- % Repairs Completed has gone down (since it was last reported on). There are five different combinations of Number of Repairs Completed vs Total Number of Repair Calls:
i. Number of Repairs Completed has decreased; Total Number of Repair Calls stays the same
ii. Number of Repairs Completed has decreased; Total Number of Repair Calls decreases, but at a slower rate
iii. Number of Repairs Completed has decreased; Total Number of Repair Calls has increased
iv. Number of Repairs Completed stays the same; Total Number of Repair Calls has increased
v. Number of Repairs Completed has increased; Total Number of Repair Calls increases, but at a faster rate
![](https://blogs.cranfield.ac.uk/wp-content/uploads/2019/11/Screenshot-2019-11-29-at-15.02.04.png)
So, when we are performance managing, each of our two performance management measures can move one of 3 ways – go up, stay the same or go down. Simples!
![](https://blogs.cranfield.ac.uk/wp-content/uploads/2019/11/Screenshot-2019-11-29-at-15.02.12.png)
But, when we are performance reporting, our one % reporting measure can move through any one of the 13 different combinations above! And I think Dilbert would have something to say about that!
And where %’s do come into their own is when drilling down using tools such as Pareto Charts to find root-causes of signals or drivers of patterns – more on this in our future blogs.
Why is the second example above – A&E attendances seen within 4 hours – a problem in trying to understand what is going on? For that you’ll need to read our next blog…
Categories & Tags:
Leave a comment on this post:
You might also like…
Keren Tuv: My Cranfield experience studying Renewable Energy
Hello, my name is Keren, I am from London, UK, and I am studying Renewable Energy MSc. My journey to discovering Cranfield University began when I first decided to return to academia to pursue ...
3D Metal Manufacturing in space: A look into the future
David Rico Sierra, Research Fellow in Additive Manufacturing, was recently involved in an exciting project to manufacture parts using 3D printers in space. Here he reflects on his time working with Airbus in Toulouse… ...
A Legacy of Courage: From India to Britain, Three Generations Find Their Home
My story begins with my grandfather, who plucked up the courage to travel aboard at the age of 22 and start a new life in the UK. I don’t think he would have thought that ...
Cranfield to JLR: mastering mechatronics for a dream career
My name is Jerin Tom, and in 2023 I graduated from Cranfield with an MSc in Automotive Mechatronics. Originally from India, I've always been fascinated by the world of automobiles. Why Cranfield and the ...
Bringing the vision of advanced air mobility closer to reality
Experts at Cranfield University led by Professor Antonios Tsourdos, Head of the Autonomous and Cyber-Physical Systems Centre, are part of the Air Mobility Ecosystem Consortium (AMEC), which aims to demonstrate the commercial and operational ...
Using grey literature in your research: A short guide
As you research and write your thesis, you might come across, or be looking for, ‘grey literature’. This is quite simply material that is either unpublished, or published but not in a commercial form. Types ...