Data Quality Index Consultation - Live-Editing Page


Instructions

  • Click on the 'Collaboration'-tab to access the live-editing document (see text below);
  • Leave your comments and/or track changes by using the top menubar inside the document;
  • For further instructions on this Connect Collaborate tool please read this two-pager, or reach out to us via connect@iatistandard.org.

1.1 Timeliness - Frequency

Definition
Assess how often a publisher's data is updated, using transaction-date elements. 
Output

Categorisation of frequency:

  • Weekly
  • Monthly
  • Quarterly
  • Six-monthly
  • Annual
  • Less than annual
Methodology - calculate frequency assessment

For publishers of 1 year or more:

  • Weekly = average of 4 updates a month across the past 12 months;
  • Monthly = 10 out of 12 of the past 12 full months;
  • Quarterly = all of the past 4 full quarters;
  • Six-monthly = both of the last 6 month periods;
  • Annual = 1 of the last 12 months;

For publishers of 6 months or more:

  • Weekly = average of 4 updates a month across the past 6 months
  • Monthly = 5 out of 6 of the past 6 full months
  • Quarterly = 2 of the past 2 full quarters
  • Six-Monthly = 1 of the last 6 months

For publishers of 3 months or more:

  • Weekly = average of 4 updates a month across the past 3 months
  • Monthly = 3 out of the past 3 full months

Quarterly = 1 out of the last 3 months

For publishers of less than 3 months:

  • Weekly = average of 4 updates a month across the past 1 month

Monthly = 1 out of the past 1 month

Note: future transaction dates will be discounted from the measure as they go against IATI rules. 


1.2.1 Timeliness - Timelag (ALL TRANSACTIONS)

Definition

Assess how recent a publisher's transaction data is at the point it is published

For instance, a publisher may refresh their data monthly, but the refreshed data is in fact three months old. Alternatively a publisher may refresh their data only once a year, but when they do it contains current data that is less than one month out of date.

Output

Categorisation of how many months in areas the data is:

  • one month in arrears
  • quarter in arrears
  • six months in arrears
  • one year in arrears
  • more than one year in arrears

Note: visualisation to show the month for which the most recent data was last updated in

Methodology

Count the number of transactions that took place in the last 12 months.

Collect when the last update date.

Calculate arrears assessment by comparing last update date to transaction dates:

  • One month in arrears = transactions with transaction dates for at least 2 of the last 3 months
  • Quarter in arrears = transactions with transaction dates for at least 1 of the last 3 months
  • Six months in arrears = transactions with transaction dates for at least 1 of the last 6 months
  • One year in arrears = transactions with transaction dates for at least 1 of the last 12 months
  • More than one year in arrears = no transactions with transaction dates in the last 12 months

Note: future transaction dates will be discounted from the measure as they go against IATI rules.


1.2.2 Timeliness - Timelag (SPEND TRANSACTIONS)

Definition
Assess how recent a publisher's spend transaction data is at the point it is published

For instance, a publisher may refresh their data monthly, but the refreshed data is in fact three months old. Alternatively a publisher may refresh their data only once a year, but when they do it contains current data that is less than one month out of date.
Output

Categorisation of how many months in arrears the data is:

  • one month in arrears
  • quarter in arrears
  • six months in arrears
  • one year in arrears
  • more than one year in arrears

Note: visualisation to show the month for which the most recent data was last updated in

Methodology

Count the number of spend transactions that took place in the last 12 months.

Collect when the last update date.

Calculate arrears assessment by comparing last update date to transaction dates:

  • One month in arrears = spend transactions with transaction dates for at least 2 of the last 3 months
  • Quarter in arrears = spend transactions with transaction dates for at least 1 of the last 3 months
  • Six months in arrears = spend transactions with transaction dates for at least 1 of the last 6 months
  • One year in arrears = spend transactions with transaction dates for at least 1 of the last 12 months
  • More than one year in arrears = no spend transactions with transaction dates in the last 12 months

Note: future transaction dates will be discounted from the measure as they go against IATI rules.


1.3 Timeliness - Spend Updates

Definition
Assess if an organization has published timely spend (transaction + expenditure) updates.
Output
Percentage.
Methodology
  • Count the number of activities with disbursement and/or expenditure transactions for each of the past 12 months. 
  • Divide by total number of activities per month.

1.4 Timeliness - Active Publishers

Definition
Assess if an organisation has updated its data within the past 12 months.
Output
Binary flag Active / Inactive.
Methodology
  • Calculate the difference between the current last-updated-date and stored last-updated-date.
  • If the difference is 12 months or greater, mark the publisher as inactive.

3.1 Validation - Summary

Definition
Display the number of critical, error,  and warning message types per publisher.
Output
Frequency Table.
Methodology
Use the Validator API to pull the count of critical, error, and warning types per publisher.

3.2 Validation - Progress

Definition
Show the changes in each publisher's validation report over time
Output
Line graph.
Methodology
  • Use the Validator API to pull the count of critical, error and warning types per publisher
  • Record the per week sum of critical, error and warning types per publisher
  • Plot these on a graph for the past 12 months

3.3 Validation - Activities

Definition
Display number and percentage of how many activities are not making it into the IATI datastore because of validation issues
Output
Number Percentage
Methodology
  • Count the number of activities in critically invalid activity files per publisher.
  • Calculate percentage of critically invalid activities, by dividing by the total number of activities

GO BACK TO MAIN DQI CONSULTATION PAGE

Be the first one to comment


Please log in or sign up to comment.