Dear IATI Connect, quick update on the IATI.cloud Datastore service. It's able to refresh all IATI data from the Registry every 6 hours. Check the IATI Querybuilder for your reference => https://datastore.iati.cloud/querybuilder/core-filters
Actual turnaround is 2h41mins based on current dataload, but we just do a full index every night. As IATI.cloud is using the AWESOMENESS provided by https://iati-data-dump.codeforiati.org/ (Thanks Mark Brough
& Andy Lulham
) which has a 3 hours cycle data refresh from the Registry we are looking what the optimal indexing schedule could be. We will probably follow the IATI DUMP cycle for incremental updates and run a full new index during weekends. tbc.
Great - thanks Siem Vaessen
- will be interesting to hear if/when you can go quicker!
It'd be really interesting to understand how periodic / predictable the growth & change of the corpus is ---> ie I guess a lot of publishers add new activities and transactions at the month end..
We soft launched the first version of Data Alerts on AIDA (https://aida.tools/app/bookmarks) that turns any bookmark on the platform into a data-alert. Enhancements on the roadmap would integrate to see actual corpus change over time. You need to sign to use bookmarks and data-alerts. Data-alerts are triggered every Monday straight into your Inbox :-)