Data quality and data integrity
07/02/2014
At yesterday’s Business Performance Roundtable we spent a lot of time looking at examples where the use of data created actionable insight with the help of David Anker from Lightfoot Solutions and Alan Meekings from Landmark Consulting.
But one of the key issues was around data. Is it good data and do we trust it? As Martin Scott of Unipart kindly reminded us, there is a quality issue and an integrity issue.
Let me give a couple of examples to illustrate the point. A hospital will have a good record of the time of first cut to discharge from the operating theatre as it is a statutory requirement. But how often do we find that the time of admission onto the ward was after the time of first cut, because someone doesn’t think the time really matters and is in a rush to complete the record? A police force may record the crimes committed but how much data do we really have. The fact that a house was entered and goods stolen is very basic. However, if we know the time of day, the entrance was via the back door, the search was tidy and only jewellery was taken we have significantly more information. Are the majority of your product failures coded under “other reasons”? That is all about data quality.
Now data integrity is about deliberate massaging of the data. Do we re-categorise violent crime to make the numbers look better? Do we delay ambulances in A&E because we need to reduce admissions and put back the start time of the four hour treatment window? Do we invoice a customer before the job is completed or the goods are dispatched to make the month end figures? Do the data jockeys remove the extreme cases of data variation when compiling data for reports? Now this is deliberate data manipulation and is about data integrity.
Mike Bourne
Categories & Tags:
Leave a comment on this post:
You might also like…
Systematic Literature Review – Identifying your search terms and constructing your search strings
Our previous posts on the systematic review have looked at getting started and selecting your sources. In this post we will look at the next fundamental stage: Identifying your search terms and constructing your search ...
Navigating the World of Robotics: My Journey at Cranfield University
Hey there, I'm Manideep, and I'm thrilled to share my experience pursuing an MSc in Robotics at Cranfield University. Let me take you through my journey and how Cranfield became the ...
Exploring safer and smarter airports with the Applied Artificial Intelligence MSc group design project
Artificial intelligence (AI) technologies have experienced rapid development in recent years, spanning from large language models (LLMs) to generative artificial intelligence (GAI). These cutting-edge advancements have significantly impacted various aspects of ...
My aerospace manufacturing journey at Cranfield University
Hey there, I'm Abhishek and I wanted to share my journey into aerospace manufacturing, guided by my experiences at Cranfield University. Let's dive into how this remarkable institution shaped my career ...
Changes to Library Services over Easter, 29 March – 1 April
Libraries on the Cranfield site Both Kings Norton Library and the School of Management Library (Building 111, first floor) will be open 24/7 over the Easter weekend. You will be able to use the study ...
How to present well as a group
You will have put a lot of work into your research or project and want to show everyone what you have achieved or discovered, so you need to impart this knowledge as clearly as possible. ...
Yes, Mike, and there is possibly a third category (or a hybrid) where people are using spread-sheets disconnected from the underlying data ignorant of unseen/obscure/hidden (in a non-malignant sense) business rules and drawing massively wrong conclusions and taking costly incorrect action as a result. This is an issue of lack of integrity in ignorance rather wilful mal-action.