Discussion

Data Quality Index - Section: New Measures

IATI Secretariat • 1 September 2021
 Data Quality Index Consultation - sub-section New Measures

Instructions for submitting your feedback
  1. Access each section by clicking on the buttons below, or download the attached full report.
  2. Share your feedback on the New Measures sub-sections of your choice through the comment-box below.
  3. Consider the guiding questions for each part, and please refer to the indicated numbers in your comments.

4.1 Basic validation measure

  • Do you agree that a publishing statistic for the Validator should be included as a dimension in the DQI index?

4.2 Data Complementarity 

  • What additional measures would you suggest adding here?


4.3 Trust in Data

  • Are there any measures that you would suggest adding that would help to assess data quality issues that impact trust in the data? 

BACK TO MAIN DQI-PAGE
​​​​​

Files

Comments (4)

Herman van Loon

4.1 Basic validation measure

  • Do you agree that a publishing statistic for the Validator should be included as a dimension in the DQI index?

    Yes. What is missing though in the Data Validator is the check on the  existence of the IATI identifiers being used. Since the existence of the IATI identifiers is critical for the quality of traceability data, this should i.m.o. be fixed as soon as possible.     
Herman van Loon

4.2 Data complementarity

Ability to assess predictability:
is an important measure not only to see if an organization follows through on their commitments, but also to monitor the progress of an activity.

Usefulness of budgets to inform budget planning:
please take for this metric also into account that many activities will have a lifespan shorter than 3 years.

Ability to assess funds flowing into and out of an organisation based on the data they report: 
please take into account that the bilateral donors at the beginning of the funding chain will have no incoming transactions, since the funding comes from the tax payer.

 

Herman van Loon

4.3 Trust in data

  • Are there any measures that you would suggest adding that would help to assess data quality issues that impact trust in the data? 

    Assess whether the publishers data can successfully be used by third party IATI applications.  
leo stolk

4.1 Basic validation measure

  • Do you agree that a publishing statistic for the Validator should be included as a dimension in the DQI index?

Yes!

4.2 Data Complementarity 

  • What additional measures would you suggest adding here?

this is a complex proposition. agree on assessment of predicatability,
I have problems with the multiyear availability for three years as criteria. Specially for INGO's funding local NGO actors. Accuracy of budget previsions depend on strengths of partnerships, strength of alliances, proposal quality and donor assessment and verdicts and their funding availability, monitoring and evaluations. All in all a too complex mix of factors. Even for bi-laterals budget planning is fluid as it more and more depends on domestic politics (see DFID FCDO) and politics in recipient country (See Mozambique 2.2 billion illegal debt scandal). 
agree on  assessing incoming and outgoing flows

4.3 Trust in Data

  • Are there any measures that you would suggest adding that would help to assess data quality issues that impact trust in the data? 

Agree with suggestions.  Possible addition is assess how organizations react to feedback from data users. Important if a feedback mechanism gets integrated in future tooling.


Please log in or sign up to comment.