Data quality and data integrity
07/02/2014
![Header-Cranfield-University Header-Cranfield-University](https://blogs.cranfield.ac.uk/wp-content/uploads/2021/07/Header-Cranfield-University-1.jpg)
At yesterday’s Business Performance Roundtable we spent a lot of time looking at examples where the use of data created actionable insight with the help of David Anker from Lightfoot Solutions and Alan Meekings from Landmark Consulting.
But one of the key issues was around data. Is it good data and do we trust it? As Martin Scott of Unipart kindly reminded us, there is a quality issue and an integrity issue.
Let me give a couple of examples to illustrate the point. A hospital will have a good record of the time of first cut to discharge from the operating theatre as it is a statutory requirement. But how often do we find that the time of admission onto the ward was after the time of first cut, because someone doesn’t think the time really matters and is in a rush to complete the record? A police force may record the crimes committed but how much data do we really have. The fact that a house was entered and goods stolen is very basic. However, if we know the time of day, the entrance was via the back door, the search was tidy and only jewellery was taken we have significantly more information. Are the majority of your product failures coded under “other reasons”? That is all about data quality.
Now data integrity is about deliberate massaging of the data. Do we re-categorise violent crime to make the numbers look better? Do we delay ambulances in A&E because we need to reduce admissions and put back the start time of the four hour treatment window? Do we invoice a customer before the job is completed or the goods are dispatched to make the month end figures? Do the data jockeys remove the extreme cases of data variation when compiling data for reports? Now this is deliberate data manipulation and is about data integrity.
Mike Bourne
Categories & Tags:
Leave a comment on this post:
You might also like…
Keren Tuv: My Cranfield experience studying Renewable Energy
Hello, my name is Keren, I am from London, UK, and I am studying Renewable Energy MSc. My journey to discovering Cranfield University began when I first decided to return to academia to pursue ...
3D Metal Manufacturing in space: A look into the future
David Rico Sierra, Research Fellow in Additive Manufacturing, was recently involved in an exciting project to manufacture parts using 3D printers in space. Here he reflects on his time working with Airbus in Toulouse… ...
A Legacy of Courage: From India to Britain, Three Generations Find Their Home
My story begins with my grandfather, who plucked up the courage to travel aboard at the age of 22 and start a new life in the UK. I don’t think he would have thought that ...
Cranfield to JLR: mastering mechatronics for a dream career
My name is Jerin Tom, and in 2023 I graduated from Cranfield with an MSc in Automotive Mechatronics. Originally from India, I've always been fascinated by the world of automobiles. Why Cranfield and the ...
Bringing the vision of advanced air mobility closer to reality
Experts at Cranfield University led by Professor Antonios Tsourdos, Head of the Autonomous and Cyber-Physical Systems Centre, are part of the Air Mobility Ecosystem Consortium (AMEC), which aims to demonstrate the commercial and operational ...
Using grey literature in your research: A short guide
As you research and write your thesis, you might come across, or be looking for, ‘grey literature’. This is quite simply material that is either unpublished, or published but not in a commercial form. Types ...
Yes, Mike, and there is possibly a third category (or a hybrid) where people are using spread-sheets disconnected from the underlying data ignorant of unseen/obscure/hidden (in a non-malignant sense) business rules and drawing massively wrong conclusions and taking costly incorrect action as a result. This is an issue of lack of integrity in ignorance rather wilful mal-action.