Release Notes for Data Sprint 20.09

Introduction

Dated: 06 October, 2020

The following list of new features, tasks and resolved bugs are included in the latest Sprint 20.09.1 release:

Features

Automatically update DataSeries.name for affected Data Series after updating DocumentType.dataseries_name_format - https://fewsnet.atlassian.net/browse/DATA-449
Prevent automatic creation of Data Source Documents on import in the Survey domain - https://fewsnet.atlassian.net/browse/DATA-488
Make Indicator a mandatory attribute for Data Series - https://fewsnet.atlassian.net/browse/DATA-511
Standardize Country Filter on Data Point Admin screens - https://fewsnet.atlassian.net/browse/DATA-518
IPC outputs should use full names for Classification Scales - https://fewsnet.atlassian.net/browse/DATA-521
Generate PNG Maps for Country Level IPC Shapefiles - https://fewsnet.atlassian.net/browse/DATA-539
Use Custom Permission instead of ‘Is Staff’ for determining whether IPC Population values are visible - https://fewsnet.atlassian.net/browse/DATA-544
Support Transit Trade Flow Type - https://fewsnet.atlassian.net/browse/DATA-548
Define recent period and collection date in api/ipcphasemap - https://fewsnet.atlassian.net/browse/DATA-551
Investigate why uploading additional IPC phases data returns invalid records - https://fewsnet.atlassian.net/browse/DATA-555

Tasks

Review of National Parks and Lakes Geographic Units in IPC Data - https://fewsnet.atlassian.net/browse/DATA-542
Load Days Work Available data in production - https://fewsnet.atlassian.net/browse/DATA-543

Bugs

Clicking on Browse button of the Single data series page (http://fdw.fews.net/en/admin/warehouse/dataseries/) does not return any values - https://fewsnet.atlassian.net/browse/DATA-471
Display a descriptive pop up message instead of the 500 Internal Error message for the restricted FAOB data which are shown from the FDW End point - https://fewsnet.atlassian.net/browse/DATA-516
Crop Production Indicator facts doesn’t work with format=xml and aggregate=true - https://fewsnet.atlassian.net/browse/DATA-525
Chart is compressed to the left when switching between tabs (Price, Trade and Other domains) - https://fewsnet.atlassian.net/browse/DATA-526

Features

Automatically update DataSeries.name for affected Data Series after updating DocumentType.dataseries_name_format - https://fewsnet.atlassian.net/browse/DATA-449

This feature enabled the automatic updating of the data series name of (https://fdw.fews.net/en/admin/warehouse/dataseries/) after making changes to the dataseries_name_format of a Document Type (https://fdw.fews.net/en/admin/warehouse/documenttype/).

Prevent automatic creation of Data Source Documents on import in the Survey domain - https://fewsnet.atlassian.net/browse/DATA-488

This feature is about disabling the automatic creation of the data_source_document upon uploading data of the survey data domains. This was previously causing errors within the Survey domain.

Make Indicator a mandatory attribute for Data Series https://fewsnet.atlassian.net/browse/DATA-511

This feature is about making Indicator a mandatory field for the data series of all the data domains. Doing this has helped further standardize the data domains within FDW, by enabling extracts of Data Points for mixed Data Domains, and providing meaningful Y axis labels on cross-domain charts.

Standardize Country Filter on Data Point Admin screens - https://fewsnet.atlassian.net/browse/DATA-518

This feature is about implementing the Country filter list for the data points admin screens of all the data domains. This allows for easier search through IPC data points.

IPC outputs should use full names for Classification Scales - https://fewsnet.atlassian.net/browse/DATA-521

This feature is about showing the full name of the IPC Classification scales in all of the IPC outputs screens, i.e https://fdw.fews.net/en/admin/ipc/ipcphase/,
https://fdw.fews.net/en/admin/warehouse/dataseries/?data_domain=IPCClassification and
https://fdw.fews.net/api/ipcclassification/.

Generate PNG Maps for Country Level IPC Shapefiles - https://fewsnet.atlassian.net/browse/DATA-539

This feature is about allowing a downloadable png map by passing parameters collection_date, country_code and scenario to the /ipcpngmap/ , i.e https://fdw.fews.net/ipcmap/?scenario=ML1&country_code=KE&collection_date=2020-09-01. This also enables users to save a png with the map, i.e https://fdw.fews.net/ipcpngmap/?scenario=ML1&country_code=KE&collection_date=2020-09-01.

Use Custom Permission instead of ‘Is Staff’ for determining whether IPC Population values are visible - https://fewsnet.atlassian.net/browse/DATA-544

This feature is about adding the new customized permission type ipc | ipc population size | Can view ipc population size actual value to the existing relevant groups which allows the user to see either the value or range of the IPC Population size.

Support Transit Trade Flow Type - https://fewsnet.atlassian.net/browse/DATA-548

This enhancement is about incorporating the Transit trade flow type to the cross border trade data domain. It is selectable under the Flow Type dropdown list.

Define recent period and collection date in api/ipcphasemap - https://fewsnet.atlassian.net/browse/DATA-551

This feature is about defining the recent period and collection date in ipcphasemap API which as a result returns the latest data collection period, for example shown here: https://fdw.fews.net/api/ipcphasemap/?format=geojson&scenario=ML1&country_code=MW .

Investigate why uploading additional IPC phases data returns invalid records - https://fewsnet.atlassian.net/browse/DATA-555

This feature is about allowing the newly added IPC data to be recognized by the system instead of shown as an invalid records which as a result allows for an outlook update.

Tasks

Review of National Parks and Lakes Geographic Units in IPC Data - https://fewsnet.atlassian.net/browse/DATA-542

This task was about adding the unit_type field to the APIs’ of the api/ipcphasemap and api/ipcpackage , for instance, (https://fdw.fews.net/api/ipcpackage/?country_code=ZW&collection_date=2020-06-01 and https://fdw.fews.net/api/ipcphasemap/?format=geojson&scenario=ML1&country_code=MW) to ensure that national parks and lakes are rendered on the IPC maps using FDW IPC data.

Load Days Work Available data in production - https://fewsnet.atlassian.net/browse/DATA-543

This task was about loading the Number_of_days_work_available historic data and the data was successfully loaded, as can be seen here: https://fdw.fews.net/en/admin/warehouse/dataupload/1763/.

Bugs

Clicking on Browse button of the Single data series page (http://fdw.fews.net/en/admin/warehouse/dataseries/) does not return any values - https://fewsnet.atlassian.net/browse/DATA-471

There was an issue in loading the data values of the single data series page (http://fdw.fews.net/en/admin/warehouse/dataseries/) when one clicks the Browse button and this was resolved.

Display a descriptive pop up message instead of the 500 Internal Error message for the restricted FAOB data which are shown from the FDW End point - https://fewsnet.atlassian.net/browse/DATA-516

Trying to access the FAOB restricted data points results in 500 Internal Server error and this was resolved and it is now showing the appropriate message.

Crop Production Indicator facts doesn’t work with format=xml and aggregate=true - https://fewsnet.atlassian.net/browse/DATA-525

There was an issue in extracting the data of the Crop Production Indicator facts with parameter types of format=xml and aggregate=true and this was resolved and the functionality is working as expected.

Chart is compressed to the left when switching between tabs (Price, Trade and Other domains) - https://fewsnet.atlassian.net/browse/DATA-526

There was a user interface issue upon switching between the tabs of the Table and Chart views for the Price, Trade and Other data domains of the FDE. This was resolved and the Chart is displayed correctly.