Release Notes for Data Sprint 20.08

Introduction

Dated: 08 September, 2020

The following list of new features, tasks and resolved bugs are included in the latest Sprint 20.08.2 release:

Features

• Prepare Country-level IPC Shapefiles https://fewsnet.atlassian.net/browse/DATA-454

• Enhanced Price Charts should support Data Sets as an input parameter https://fewsnet.atlassian.net/browse/DATA-468

• Better IPC Phase Imports https://fewsnet.atlassian.net/browse/DATA-481

• In FDE, disable Data Series that have no Data Points https://fewsnet.atlassian.net/browse/DATA-483

• Enable Self-Service Password Reset for FDW accounts https://fewsnet.atlassian.net/browse/DATA-484

• Allow single sign-on to FDW from hub.fews.net Google Accounts https://fewsnet.atlassian.net/browse/DATA-487

• Enhance the Crop Production Dashboard to show Season https://fewsnet.atlassian.net/browse/DATA-493

• Expose other formats in FDE refreshable links https://fewsnet.atlassian.net/browse/DATA-499

• Allow DataSeries search by FNID https://fewsnet.atlassian.net/browse/DATA-500

• Extend Data Domain list filters to include Semi Structured Document Types https://fewsnet.atlassian.net/browse/DATA-505

• Support Semi Structured Data Series in Add Data Collection https://fewsnet.atlassian.net/browse/DATA-507

• Add a chart tab in the Other domain in FDE https://fewsnet.atlassian.net/browse/DATA-510

• Add a `collection_date` filter to DataPointFilter https://fewsnet.atlassian.net/browse/DATA-514

• Add From Unit Type and To Unit Type to Geographic Unit Relationship Admin https://fewsnet.atlassian.net/browse/DATA-515

Tasks

• Changing document type for historical FAOB data https://fewsnet.atlassian.net/browse/DATA-330

• Review the fields displayed on the pop up on Spatial domain map https://fewsnet.atlassian.net/browse/DATA-372

• Correct problematic unit of measures and conversions https://fewsnet.atlassian.net/browse/DATA-401

• Unable to load AF_LHZ_2011 livelihood file https://fewsnet.atlassian.net/browse/DATA-443

• Unable to load RW_LHZ_2012 livelihood file https://fewsnet.atlassian.net/browse/DATA-448

• Add a Data Usage Policy Justification for FEWS NET Only https://fewsnet.atlassian.net/browse/DATA-492

• Update IPC Spreadsheets with calculated column headings https://fewsnet.atlassian.net/browse/DATA-494

• Need assistance in changing Market names https://fewsnet.atlassian.net/browse/DATA-512

Bugs

• Editing a CPCv2 code generates 500 Internal server error https://fewsnet.atlassian.net/browse/DATA-74

• The Common_unit_quantity data values of the Trade data domain are all shown in scientific notation https://fewsnet.atlassian.net/browse/DATA-385

• Classified Product Change Screen is very slow https://fewsnet.atlassian.net/browse/DATA-398

• Accessing Mayan system for a newly created users redirects to URL of https://fdw.fews.net/documents/accounts/social/signup/ https://fewsnet.atlassian.net/browse/DATA-437

• Logout of Mayan not working https://fewsnet.atlassian.net/browse/DATA-478

• FDE Price chart download as image contains the overview chart and zoom https://fewsnet.atlassian.net/browse/DATA-501

• Filtering either by Geographic unit or Start date & End date is not working for the Semi-structured data from the FDE Interface https://fewsnet.atlassian.net/browse/DATA-513

Features

Prepare Country-level IPC Shapefiles https://fewsnet.atlassian.net/browse/DATA-454

• This feature is about generating the first steps toward automating the delivery of IPC Classification shapefiles into the final package including the readme file and other ancillary files and ultimately uploading them to the website. This process includes the creation of the Drupal Node with the correct metadata for the website.

Enhanced Price Charts should support Data Sets as an input parameter https://fewsnet.atlassian.net/browse/DATA-468

• This feature is about adding the parameter Data Sets so it is visible in the price chart dashboard, which is located at https://fdw.fews.net/dashboard/price/.

Better IPC Phase Imports https://fewsnet.atlassian.net/browse/DATA-481

• This enhancement is about making changes on the IPC template file to enhance the IPC import process, adding performance and functional improvements.

In FDE, disable Data Series that have no Data Points https://fewsnet.atlassian.net/browse/DATA-483

• This feature is about disabling the data series of the FDE data domains which do not have data point values.

Enable Self-Service Password Reset for FDW accounts https://fewsnet.atlassian.net/browse/DATA-484

• This feature is about enabling self-service password reset for the FDW accounts by clicking the Forgot Password button from the log in page of the FDW. This way, users can reset their own passwords, as opposed to requesting Helpdesk support (https://fdw.fews.net/en/).

Allow single sign-on to FDW from hub.fews.net Google Accounts https://fewsnet.atlassian.net/browse/DATA-487

• This enhancement is about authenticating users from hub.fews.net google accounts i.e allowing FEWS NET users to click the FEWS NET button from the login page (https://fdw.fews.net/en/) that authenticate them using their FEWS NET G-Suite accounts .

Enhance the Crop Production Dashboard to show Season https://fewsnet.atlassian.net/browse/DATA-493

• This feature is about displaying the season break down in the crop production dashboard, which is located at https://fdw.fews.net/dashboard/crop-production/.

Expose other formats in FDE refreshable links https://fewsnet.atlassian.net/browse/DATA-499

• This enhancement is about incorporating the list of available export options to allow downloads in other formats of the FDE refreshable links, such as CSV, HTML, JSON, and XML.

Allow DataSeries search by FNID https://fewsnet.atlassian.net/browse/DATA-500

• This feature is about enhancing the search capability of the data series admin pages to allow search by the FNID field.

Extend Data Domain list filters to include Semi Structured Document Types https://fewsnet.atlassian.net/browse/DATA-505

• This enhancement is about incorporating the semi-structured document types as individual entries in the data domain list and using this same filter list for data collection (https://fdw.fews.net/en/admin/warehouse/datacollection/), data collection period (https://fdw.fews.net/en/admin/warehouse/datacollectionperiod/) and data series (https://fdw.fews.net/en/admin/warehouse/dataseries/) admin screens.

Support Semi Structured Data Series in Add Data Collection https://fewsnet.atlassian.net/browse/DATA-507

• This feature is about incorporating the semi-structured data in the Add Data Collection admin pages for automatic recognition of the data points from data collection files.

Add a chart tab in the Other domain in FDE https://fewsnet.atlassian.net/browse/DATA-510

• This enhancement is about incorporating the Chart tab in Other data domain of the FDE, so that it is now selectable.

Add a `collection_date` filter to DataPointFilter https://fewsnet.atlassian.net/browse/DATA-514

• This feature is about adding the collection_date  filter to DataPointFilter API end point, which is located at https://fdw.fews.net/api/datapoint/.

Add From Unit Type and To Unit Type to Geographic Unit Relationship Admin https://fewsnet.atlassian.net/browse/DATA-515

• This feature is about implementing From Unit Type & To Unit Type , can_aggregate_from_to and can_aggregate_to_from  fields as a read-only to the Geographic Unit Relationship Admin list and change screens. In addition to this, the Country & Unit Type filters have been added to the list filters of the Geographic Unit Relationship Admin screen.

Tasks

Changing document type for historical FAOB data https://fewsnet.atlassian.net/browse/DATA-330

• This task was about moving all the historical FAOB data to document type IPC Population under the source document of FAOB (Population).

Review the fields displayed on the pop up on Spatial domain map https://fewsnet.atlassian.net/browse/DATA-372

• This task was about displaying the relevant field parameters on the pop up of the spatial data domain map view (https://fdw.fews.net/data-explorer/#/spatial).

Correct problematic unit of measures and conversions https://fewsnet.atlassian.net/browse/DATA-401

• This task was about correcting the missing Unit of measure conversions and the conversion issues of Unit of measure between the different types of unit of measures .

Unable to load AF_LHZ_2011 livelihood file https://fewsnet.atlassian.net/browse/DATA-443

• This task was about providing support in uploading the Livelihood Zones data of Afghanistan, and the data was successfully loaded (https://fdw.fews.net/en/admin/spatial/livelihoodzone/?country__iso3166a2__exact=AF).

Unable to load RW_LHZ_2012 livelihood file https://fewsnet.atlassian.net/browse/DATA-448

• This task was about providing support on uploading the Livelihood Zones data of Rwanda, and the data was successfully loaded (https://fdw.fews.net/en/admin/spatial/livelihoodzone/?country__iso3166a2__exact=RW).

Add a Data Usage Policy Justification for FEWS NET Only https://fewsnet.atlassian.net/browse/DATA-492

• This task was about creating a data usage policy justification entry for FEWS NET Only ,(https://fdw.fews.net/en/admin/warehouse/datausagepolicyreason/7/change/) which can be used as a placeholder until we get the final list of allowable justifications.

Update IPC Spreadsheets with calculated column headings https://fewsnet.atlassian.net/browse/DATA-494

• This task was about making changes in the templates of the IPC Spreadsheets to ensure that the headers are calculated automatically and which, as a result makes it easily to be recognized and parsed by FDW.

Need assistance in changing Market names https://fewsnet.atlassian.net/browse/DATA-512

• This task was about cascading any changes made on the market Name to the Full Name of the Market screen, for instance shown here: https://fdw.fews.net/en/admin/spatial/market/57778/.

Bugs

Editing a CPCv2 code generates 500 Internal server error https://fewsnet.atlassian.net/browse/DATA-74

• The system threw a 500 Internal server error upon trying to edit the CPCv2 code and this was resolved by making the cpcv2 code read-only.

 The Common_unit_quantity data values of the Trade data domain are all shown in scientific notation https://fewsnet.atlassian.net/browse/DATA-385

• The Common_unit_quantity data values of the trade data domain were all shown in scientific notation and this was resolved and they are shown in standard notation.

Classified Product Change Screen is very slow https://fewsnet.atlassian.net/browse/DATA-398

• The Classified Product Change screen (https://fdw.fews.net/en/admin/common/classifiedproduct/R01111AA/change/) was slow in loading the data values and this was resolved.

 Accessing Mayan system for a newly created users redirects to URL of https://fdw.fews.net/documents/accounts/social/signup/ https://fewsnet.atlassian.net/browse/DATA-437

• Trying to access the Mayan system for a newly created user redirected to the URL of https://fdw.fews.net/documents/accounts/social/signup/ and this was resolved.

Logout of Mayan not working https://fewsnet.atlassian.net/browse/DATA-478

• The log out functionality of the Mayan system was only logging the user out of FDW, but not Mayan, and this was resolved and it is working as expected (.i.e it now logs the user out of both Mayan and FDW Systems).

FDE Price chart download as image contains the overview chart and zoom https://fewsnet.atlassian.net/browse/DATA-501

• There were four minor issues that arose upon trying to download the price chart as a .png from the FDE (https://fdw.fews.net/data-explorer/#/price) and this was resolved.

Filtering either by Geographic unit or Start date & End date is not working for the Semi-structured data from the FDE Interface https://fewsnet.atlassian.net/browse/DATA-513

• There was an issue in filtering the semi-structured data from the FDE end point (https://fdw.fews.net/data-explorer/#/other) either by using Geographic unit or Start date & End date criteria. This was resolved and the functionality is working as expected.