Release Notes for Sprint 20.01
Introduction
Dated: 13 February 2020
In this sprint release document, the features and defects below have been resolved and deployed to the production FDW/FDE server.
Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46
Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94
Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96
Support GeoJSON format extracts in DataPoint APIs https://fewsnet.atlassian.net/browse/DATA-130
Implement an OpenAPI Schema to make it easier to use the REST API https://fewsnet.atlassian.net/browse/DATA-134
Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136
Associate the document type based permissions to the FEWS NET Staff and FDE Only roles https://fewsnet.atlassian.net/browse/DATA-145
Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149
Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155
Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170
Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed https://fewsnet.atlassian.net/browse/DATA-180
Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80
Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146
Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156
In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166
Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173
New Features
Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46
This feature is about making change on a `warehouse_datapointfacts_view` so that it excludes Data Points that are Crop Production Indicator Values (using the
specialization_type
) and checks on the difference in time to refresh the view before and after the change, which as a result improves performance for refreshing the Data Point Facts materialized view.
Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94
This feature is about allowing users to search the exchange rate by country name and in addition, the calculated name of the exchange rate data series has also been changed to include `from_currency_iso_en_name` and the `to_currency_iso_en_name` as shown below:
Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96
This feature is about separating the Border Point value from the Market, i.e the Border Point becomes a separate list under the sub-class of the Geographic unit like shown below:
Support GeoJSON format extracts in DataPoint APIs https://fewsnet.atlassian.net/browse/DATA-130
This feature is about implementing GeoJSON format extracts in DataPoint APIs, which as a result, will be used in GIS tools for generating Maps, etc.
Implement an OpenAPI Schema to make it easier to use the REST API https://fewsnet.atlassian.net/browse/DATA-134
This enhancement is about implementing an OpenAPI Schema to make it easier for users who wish to make API requests to use the REST API.
Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136
This feature is about improving the speed of FDE tables, maps and charts by only extracting the required fields.
Associate the document type based permissions to the FEWS NET Staff and FDE Only roles https://fewsnet.atlassian.net/browse/DATA-145
This enhancement is about associating the document types to the Groups of
FDE Only
&FEWS NET Staff
so that the users which are assigned to the groupFDE Only
can access only the documents which they are allowed to access and can only view theData Explorer
, whereas the users which are assigned to the groupFEWS NET Staff
may access all the total documents and can also access/view theData Explorer & Data Management
.
As a FDE Only user
As a FEWS NET Staff user
Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149
This task is about upgrading Mayan to 3.3 and this upgrade introduced key major changes in the user interface of the Mayan system by introducing the features listed below:
Increasing the role label field size from 64 to 128 characters
Darkening content area when opening the mobile menu
Hiding the multi-item selection help text on mobile screens
Removing body spacer HTML and JavaScript. Not needed with the new UI
Adding support for icon shadows
Back porting the vertical main menu update
Adding support for menu inheritance
Converting document image cache to use file cache manager app. Added setting DOCUMENTS_CACHE_MAXIMUM_SIZE defaults to 500 MB
Using timezone aware date for document statistics
Updating mayan_statistics migration 0002 to rename duplicate slugs
Removing index create permission as an ACL permission for indexes
The upgrade also resolves the bugs listed below:
Username color on mobile screens not being user friendly
The Mayan statistics app that fails to render correct value when the current month is December
Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155
Since FDW depends on the Pandas library to perform statistical calculations and data re-sampling and we were using version 0.22 which is very old. So this task upgraded Pandas to 0.23.4, which is a much more modern version.
Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170
This feature is about adding the
FEWS NET only
visibility option to a saved dataset of all the data domains of the FDE.
Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed https://fewsnet.atlassian.net/browse/DATA-180
There were crop datasets which were sourced from the Public, but these datasets had the visibility type of ‘FEWS NET Only’ so this task was to change these datasets to the ‘Public’ visibility type.
Resolved Defects
Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80
For about 41 countries the FNID codes of the Admin 0 units were missing the year component and it is now resolved for all of these countries.
Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146
Due to a configuration error at the time of migration to the FEWS NET AWS infrastructure, the fdwdev and fdwprd environments were both sharing the same Postgres database and it is resolved now.
Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156
On Crop data domain, the Geographic filter took longer time to popup its values than it should have, and now the performance has been improved to be more consistent with the other geographic filter values' performance.
In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166
Admin 3 units of some countries were shown as list of countries under both M49 or FN Regions, which was incorrect, and this has been resolved.
Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173
There was an issue on the data upload page, i.e when one clicks on the
Add data upload
button it results in the screenshot below. Users were unable to select theFile
,Import format
,subtype
, and theFile
field were hidden like you see in the screenshot below, and this was resolved so that the fields are now selectable.