Data quality and data integrity
07/02/2014

At yesterday’s Business Performance Roundtable we spent a lot of time looking at examples where the use of data created actionable insight with the help of David Anker from Lightfoot Solutions and Alan Meekings from Landmark Consulting.
But one of the key issues was around data. Is it good data and do we trust it? As Martin Scott of Unipart kindly reminded us, there is a quality issue and an integrity issue.
Let me give a couple of examples to illustrate the point. A hospital will have a good record of the time of first cut to discharge from the operating theatre as it is a statutory requirement. But how often do we find that the time of admission onto the ward was after the time of first cut, because someone doesn’t think the time really matters and is in a rush to complete the record? A police force may record the crimes committed but how much data do we really have. The fact that a house was entered and goods stolen is very basic. However, if we know the time of day, the entrance was via the back door, the search was tidy and only jewellery was taken we have significantly more information. Are the majority of your product failures coded under “other reasons”? That is all about data quality.
Now data integrity is about deliberate massaging of the data. Do we re-categorise violent crime to make the numbers look better? Do we delay ambulances in A&E because we need to reduce admissions and put back the start time of the four hour treatment window? Do we invoice a customer before the job is completed or the goods are dispatched to make the month end figures? Do the data jockeys remove the extreme cases of data variation when compiling data for reports? Now this is deliberate data manipulation and is about data integrity.
Mike Bourne
Categories & Tags:
Leave a comment on this post:
You might also like…
Setting up a private group on Mendeley to support your group project
Many of our students are busy working on their group projects. Our top tip is to set up a private group on Mendeley. You can use it to store all your references, and to share ...
Tell us what you think of Library Services!
We want our students to have a great experience during their time at Cranfield. Each month, the University runs a short “Topic of the month” survey to focus on one service or facility and find ...
Air Transport Management alumni stories: SangHo (Henry) Han, Strategic Planning Manager in South Korea
SangHo (Henry) Han is a strategic planning manager at Air Premia in South Korea. He graduated from Cranfield University with an MSc in Air Transport Management in 2018. Here, Henry talks about his passion for ...
Life on campus and studying an Advanced Water Management MSc at Cranfield
After a year of working in the water, sanitation, and hygiene sector, I started to look for opportunities to further my knowledge about water resources. Researching water organisations on LinkedIn led me to find ...
Sign up to our ‘Making your research open access’ webinar – 9 February
Do you know your green from your gold? What are publisher deals, and how can they help you? My paper acknowledges UKRI funding, do I need to do anything special? What does an author accepted ...
How the Executive Logistics and Supply Chain Management MSc improved my career outlook
Hear from Harrison Jnr Ilodiwe, Executive Logistics and Supply Chain Management MSc, on his student experience at Cranfield. Why did you choose to study the Executive Logistics and Supply Chain Management MSc at Cranfield ...
Yes, Mike, and there is possibly a third category (or a hybrid) where people are using spread-sheets disconnected from the underlying data ignorant of unseen/obscure/hidden (in a non-malignant sense) business rules and drawing massively wrong conclusions and taking costly incorrect action as a result. This is an issue of lack of integrity in ignorance rather wilful mal-action.