Data quality and data integrity
07/02/2014

At yesterday’s Business Performance Roundtable we spent a lot of time looking at examples where the use of data created actionable insight with the help of David Anker from Lightfoot Solutions and Alan Meekings from Landmark Consulting.
But one of the key issues was around data. Is it good data and do we trust it? As Martin Scott of Unipart kindly reminded us, there is a quality issue and an integrity issue.
Let me give a couple of examples to illustrate the point. A hospital will have a good record of the time of first cut to discharge from the operating theatre as it is a statutory requirement. But how often do we find that the time of admission onto the ward was after the time of first cut, because someone doesn’t think the time really matters and is in a rush to complete the record? A police force may record the crimes committed but how much data do we really have. The fact that a house was entered and goods stolen is very basic. However, if we know the time of day, the entrance was via the back door, the search was tidy and only jewellery was taken we have significantly more information. Are the majority of your product failures coded under “other reasons”? That is all about data quality.
Now data integrity is about deliberate massaging of the data. Do we re-categorise violent crime to make the numbers look better? Do we delay ambulances in A&E because we need to reduce admissions and put back the start time of the four hour treatment window? Do we invoice a customer before the job is completed or the goods are dispatched to make the month end figures? Do the data jockeys remove the extreme cases of data variation when compiling data for reports? Now this is deliberate data manipulation and is about data integrity.
Mike Bourne
Categories & Tags:
Leave a comment on this post:
You might also like…
Connected and Autonomous Vehicle Engineering (Automotive) MSc alumnus Nirmal Jose: My experience at Cranfield and my career so far
Nirmal Jose completed the Connected and Autonomous Vehicle Engineering (Automotive) (CAVE) MSc in 2022. Here he talks about why the automotive industry is such an exciting place to be, his experience of studying at Cranfield, ...
A Day at the Explorers Festival
An Explorer's Spark “There is an explorer’s ‘spark’ that is felt at these events”, said National Geographic CEO Jill Tiefenthaler at the Explorers Festival in London on April 20; it was a spark felt by ...
How do I reference… a newspaper article in the APA7 style?
If you're using newspaper content in your work, you may be wondering how to reference it. Is it exactly the same as a journal article reference? Well, it's pretty similar. Here's a short guide. To ...
Resource trial: Writefull
Throughout June, Library Services are running a trial for Writefull which provides tools to help with academic writing. Writefull's support includes proofreading, spelling and grammar checking your work. It can also help you craft your ...
Working smarter, cleaner and greener: The future of manufacturing and materials
Everything we own, use or interact with in life starts with a material or materials. But even we in the industry admit that materials are a huge part of what has led us to where ...
Hubert Ovie Madise: My group design project
'Hubert Ovie Madise, what have you been up to the past ten weeks?' The Cranfield School of Water, Energy and Environment (SWEE) Group Design Project (GDP) module - that's what! The SWEE GDP module ...
Yes, Mike, and there is possibly a third category (or a hybrid) where people are using spread-sheets disconnected from the underlying data ignorant of unseen/obscure/hidden (in a non-malignant sense) business rules and drawing massively wrong conclusions and taking costly incorrect action as a result. This is an issue of lack of integrity in ignorance rather wilful mal-action.