Comments on: There is no such thing as a data quality problem…

By: Julian Schwarzenbach

Julian Schwarzenbach — Sat, 06 Feb 2010 20:23:42 +0000

Glad the post was of use.
It certainly has promoted lots of comments and debate. Some readers are in agreement, others seem to view it as an overgeneralisation. As mentioned before, this post was deliberately meant to be a little provocative to counter the views of some who believe that the application of technology (MDM, data profiling) etc. is ‘the answer’. These techniques and tools do have value, but only as part of an overall solution to data quality management.

By: Would you allow this…? « Data and Process Advantage Blog

Would you allow this…? « Data and Process Advantage Blog — Mon, 01 Feb 2010 13:04:02 +0000

[...] users, data administrators and external parties. I have referred to this in a previous post “There is no such thing as a data quality problem…” which was deliberately being a little provocative in order to make a point. In this related [...]

By: Similarities between data quality issues and computer security security approaches? « Data and Process Advantage Blog

Fri, 27 Nov 2009 10:44:50 +0000

[...] security exploits rely on the fallibility of humans, as stated in a previous post data quality issues typically have root causes of human [...]

By: Ark Wingrove

Ark Wingrove — Fri, 27 Nov 2009 00:25:23 +0000

Rather than trying to define the scenario that eventually leads to bad data it may be better, (and easier) to define the criteria for success, my starter for 10 would be:

- A software package that is easy and straightforward to use (for a USER and not a tecchy!)

- A software package that is easy to update (same caveat as above)

BUT

- A change control procedure that prevents excessive or adverse customisation

and

- Constant, organisational interest in data integrity, followed by corrective action when necessary (retraining, changes to code lists etc)

facilitated by

- A strong user group that “owns” the system and feels empowered to tune the system to achieve its goals

goals which..

- Will (of course) be clear, concise and communicated

One day we will get there!

By: Laurie Reynolds

Laurie Reynolds — Mon, 23 Nov 2009 23:10:21 +0000

I believe the problem here is not the people, good or bad, its the lack of strong asset data models which capture the relationships and behaviour relevant to the business problem being analysed.
The reference to bus drivers reminded me of a lecture I attended 20 years ago by Stafford Beer, one of the gurus of systems thinking. He had been working in Chile assisting Che Guevara’s government measure the impact of alternative economic policies. They needed an indicator which was a fast acting measure of economic activity and chose to measure the number of bus tickets sold on the buses each day and it was the bus conductor not the driver who owned the data. The data owner should be the individual who has the greatest stake in ensuring the data is correct, not the senior manager of the department? Maybe we need more bus conductors again?