December 2022/January 2023 Release Notes

The following list of new features, updates and bug fixes are included in the latest Sprint 22.12 release to the FEWS NET Data Platform.

New Features

New FDW Search and Filter Options

Data can be more efficiently filtered in the FDW through the following features:

• The filter pane in the FDW now includes a search box which can be used to narrow down the available filters (DATA-2336)

• Dataseries Admin screens have a FEWS NET Country Group filter option to allow the selection of data for a given region (DATA-2160)

Updates

Metadata Management Updates

The management of metadata in the FDW has been refined through the inclusion of additional information and new endpoints. Updates include:

• Metadata endpoints for ‘commoditybalancevalue’ and ‘commoditybalancefacts’ have been created for the Balance domain (DATA-1970)

• All necessary fields are now defined for the Secondary Price Indexes and Exchange rate endpoints. (DATA-1972)

• All existing indicators now include values in the aggregation and description fields (DATA-1973)

• The data source document field for datausage_notes is included in the metadata API extracts as part of the description column (DATA-2082)

• Foreign name fields have been added to GeographicUnitSerializer (DATA-2153)

• Management of narrative metadata type and narrative metadata have been added to the admin screens as part of common metadata (DATA-2188)

• The availability and availability description columns are included in ‘fields=simple’ (DATA-2300)

Improvements to Extracts and APIs

Data extraction has been made more comprehensive and accurate through the following updates:

• Extra attributes are included in extracts by geographic unit type (DATA-1612)

• The FNID, a unique code used to identify every Geographic Unit in the system, is now included in all Spatial extracts, simple or otherwise (DATA-2238) 

• An API has been created for Seasons data (DATA-2253)

• The ‘geographicrelationship’ API endpoint returns fields for label and category (DATA-2219)

• A new spreadsheet in EmergencyFoodAssistancePeakNeedsListViewSet is being used for api/efapeakneeds/ due to issues with csv parsing when column headers contain special characters or spaces (DATA-2213)

• A full name column has been added to Data Source Documentation Organization to allow the entire name to be included in all metadata extracts. (DATA-2301)

FDE Refinements

FDE user experience was refined through the following tickets:

• The list of most visited domains and datasets was updated to be more accurate (DATA-1813)

• The guided tour was integrated into a user profile in order to automatically launch the tour for first-time users (DATA-1877)

• Pagination has been added to the dataseries table to improve the loading of results (DATA-2162)

• Update to the language of the download notification (DATA-2325)

Automated ingestion of Price Projection spreadsheets from Google Drive (DATA-1879)

A luigi pipeline was developed to ingest price projection spreadsheets from Google Drive.

Data collection text boxes for metadata (DATA-2198)

The inline tabular display for data collections was improved to allow users to see the full text of important metadata columns.

Bug Fixes

Change country name of the exchange rate of Bolivar Digital per USD from World to Venezuela (DATA-2294)

The secondary exchange rate for VED (Bolivar Digital) per USD listed ‘World’ as the country. This has been corrected to list Venezuela.

MarketPriceProjectionvalue period date is not the last day of the month (DATA-2215)

The output of SemiStructuredDataPoint.objects.filter( 2 dataseries=6827441, 3).values( 4 'datacollectionperiod__period_date', 5) gave incorrect period dates that do not correspond to the last day of the month. The monthly data source documents will now be checked and corrected for the period date being the last day of the month where applicable.

Bug Fixes in the FDE

• An issue with the FDE sidebar not retaining the user’s scroll position was corrected to function correctly within and across pages (DATA-2074)

• Maps in FDE were not resizing correctly when the main sidebar is collapsed. Maps now fill the interface in response to user interactions (DATA-2122)

• The flow type and trade type were not working correctly on the trade domain. This has been resolved by changing ‘key’ to ‘value’ in trade-filter-config.js file (DATA-2234)

• The ‘Data Management’ button has been removed from the FDE2 homepage for the external users group (DATA-2281)

• The selected tab underline in FDE data series table did not match the label width. This was corrected so that the selected tab underline matches the length and position of the tab’s text label. (DATA-2282)

• The height of the API LINK div on the Price Table was reduced to eliminate an overlap with the horizontal scroll bar for Ubuntu OS running Chrome (DATA-2296)

• An error causing scroll bars to malfunction after closing the FDE guided tour has been fixed to allow users to scroll normally (DATA-2299)

• The Reset Search button on FDE domain pages has been corrected to clear only the existing search parameters, and not a user’s selected data series. (DATA-2323)

• The height of the FDE filter header and the placement of the ‘save search’ button after search parameters are entered have been corrected (DATA-2324)