The following list of updates and bug fixes are included in the latest Sprint 25.10 release to the FEWS NET Data Platform.
Updates
Data ingestion pipeline updates
The following updates were made to FDW’s data ingestion pipelines:
-
Updated the ACLED pipeline in light of the current ACLED API changes (DATA-4563).
-
The SMPG pipeline now checks for historic data alongside new data for existing data series by filtering for the most recent period date (DATA-4729).
-
Updated the IOM pipeline to ingest up-to-date migration data from a wide range of countries, which can be visualized on the Key Risk Drivers Map in FDE (DATA-4805).
Create a read-only API for Data Usage Policy Reason (DATA-4719)
Created a /datausagepolicyreason API endpoint to help facilitate bulk uploads of non-public assets that require a Data Usage Policy Reason.
Add asset_count to Data Source admin screen (DATA-4717)
The Data Source Document admin screens in FDW and the /datasourcedocument API endpiont display the number of assets for each Data Source Document.
Add datasourcedocument_count to Data Usage Policy admin screens and serializers (DATA-4720)
The Data Usage Policy admin screens in FDW and the /datausagepolicy API endpoint display the number of Data Source Documents for each Data Usage Policy.
Final adjustments for preferred_name field (DATA-4730)
Improved the handling of preferred names in FDW to add verbose names and handle preferred names in multiple languages.
FDE updates
Data Sources
The following tickets were completed as part of the new UI integrating the Data Sources functionality:
-
Added a Data Sources section where users can search and view details for Data Sources (DATA-4623).
-
Redesigned the sidebar for the Data Sources and Explore data sections (DATA-4576).
-
Created nested topics and subtopics for the Data Sources and Explore data sidebars (DATA-4732).
-
While using the Explore data section, users can now access the Data Source detail page for a given Data Source from links in the Data Series table and the Metadata tab (DATA-4625).
-
Updated the built-in tour to reflect the new Data Sources functionality (DATA-4728).
-
Updated the visualization section to integrate with the revised navigation UI (DATA-4700).
-
Updated the terminology used in FDE (DATA-4689). This includes the following changes:
-
Domains are now called Topics.
-
Data Source Documents are now called Data Sources.
-
Data Source Organizations are now called Source Organizations.
-
Bugs
Review ACLED fields=acled error and fix it (DATA-4248)
The fields=acled parameter for extracting ACLED data from the API was not returning the expected fields. The parameter can now be used to get extracts that use the original fields from ACLED.
DocumentTypeViewSet doesn’t return Document Types without Source Documents (DATA-4721)
Document Types without a Source Document were being excluded when accessing a list of Document Types through the API. Now, users with appropriate permissions can access the full list as well as filter by has_datasourcedocuments.
FDE bugs
The following bug fixes were completed for FDE:
-
Resolved issues with the reset password flow that prevented users from successfully reseting their password. The automated email and password reset popup now allow you to create a new password as expected (DATA-4703).
-
FDE was showing a blank screen when users tried to view Datasets with zero Data Series. All Data Sets now load correctly (DATA-4672).
-
The option to select Somalian Shillings (SOS) as the common currency was missing from the Customize options when previewing prices data. Somalian Shillings now appear in the dropdown and can be used as the common currency when previewing and extracting prices data (DATA-4753).
-
Trade Data Series were not loading after selecting the Date filter. The Date filter now shows all relevant results (DATA-4804).