Release Notes for Data Sprint 20.04
Introduction
Dated: 14 May, 2020
In this Release Notes document, the following main features, tasks and defects have been resolved and deployed to the FDE/FDW production server - Version 20.04.5.
Features
Add Market Product and Market Price ViewSet filters for Staple Foods https://fewsnet.atlassian.net/browse/DATA-123
Implementation of Geographic Unit View within FDE https://fewsnet.atlassian.net/browse/DATA-214
Use pagination in FDE Crop Production tab https://fewsnet.atlassian.net/browse/DATA-233
Standardize Country Filter on Data Series Admin screens https://fewsnet.atlassian.net/browse/DATA-239
Refactor GeographicUnitTreeViewSet to improve performance https://fewsnet.atlassian.net/browse/DATA-245
Implement Django Celery Results for API data ingestion https://fewsnet.atlassian.net/browse/DATA-247
Standarize Data Domain parameters in API URLs Story https://fewsnet.atlassian.net/browse/DATA-255
Enhanced Document List API for Mayan https://fewsnet.atlassian.net/browse/DATA-256
Add Description to Data Series Search fields https://fewsnet.atlassian.net/browse/DATA-263
Bulk import feature for adding border towns to FDW https://fewsnet.atlassian.net/browse/DATA-265
Consistent Y axis over time for Sub National Crop Production Dashboard https://fewsnet.atlassian.net/browse/DATA-269
Standardize Geographic Unit and Indicator foreign keys to Data Series https://fewsnet.atlassian.net/browse/DATA-271
Faster responses for paginated Crop Production API calls https://fewsnet.atlassian.net/browse/DATA-276
Additional Unit Tests for Spatial APIs https://fewsnet.atlassian.net/browse/DATA-283
Tasks
Support on trouble shooting IPC file data uploads https://fewsnet.atlassian.net/browse/DATA-236
Validate email addresses to ensure there is 1 address per 1 user https://fewsnet.atlassian.net/browse/DATA-249
Review of FDW Data Point API extract formats for Markets and Trade https://fewsnet.atlassian.net/browse/DATA-258
Incorporate Formatting Guidance into Price Charts https://fewsnet.atlassian.net/browse/DATA-272
Bugs/Defects
Geography filter is not caching correctly https://fewsnet.atlassian.net/browse/DATA-238
Clicking on the Help with the current page tab of each pages of the FDW results in 404 error https://fewsnet.atlassian.net/browse/DATA-243
Investigate Data Domains filter behaviour in Data Inventory dashboard https://fewsnet.atlassian.net/browse/DATA-250
Unable to upload Cameroon shape file https://fewsnet.atlassian.net/browse/DATA-254
Saving data set is not working at the subgroup level of the IPC FIC Data domain https://fewsnet.atlassian.net/browse/DATA-266
Features
Add Market Product and Market Price ViewSet filters for Staple Foods
This feature is about using the attribute
Is Staple Foodfor filtering the results that came from /api/marketproduct or /api/marketprice or /api/marketpricefacts, for instance, by using the links: https://fdw.fews.net/api/marketprice/?country=XX&?is_staple_food or https://fdw.fews.net/api/marketpricefacts/?country=XX&is_staple_food or https://fdw.fews.net/api/marketproduct/?country=XX&is_staple_food .
Implementation of Geographic Unit View within FDE
This feature is about implementing the Map tab on the Spatial data domain (https://fdw.fews.net/data-explorer/#/spatial) in FDE. In addition to this, if the user selects one or more Geographic Unit Set Versions and Unit Type, then the Features can be extracted as GeoJSON with queries like: https://fdw.fews.net/api/feature/?format=geojson&unit_set_version=XXX&unit_set_version=XXX , https://fdwdev.fews.net/api/feature/?format=geojson&unit_set_version=XXX&unit_set_version=XXX&unit_type=adminX
Use pagination in FDE Crop Production tab
This feature is about implementing the pagination response of the crop production indicator API which greatly enhances the extract performance of the data domain (https://fdw.fews.net/data-explorer/#/crop)
Standardize Country Filter on Data Series Admin screens
This feature is about implementing the Country filter list for all the data series admin screens of the data domains.
Refactor GeographicUnitTreeViewSet to improve performance
This feature is about caching the response of the Geography filter of the Crop production which as a result greatly improves the performance of the the Geographic filter response of the crop data domain (https://fdw.fews.net/data-explorer/#/crop).
Implement Django Celery Results for API data ingestion
This feature is about implementing Celery Results for API data ingestion (https://fdw.fews.net/en/admin/django_celery_results/taskresult/) which returns the log file output of the import process.
Standardize Data Domain parameters in API URLs Story
This feature is about standardizing the API URLs of all the data domain parameters of the FDW environments.
Enhanced Document List API for Mayan
This enhancement is about implementing the pagination functionality for the Mayan document list APIs, like we have it here https://fdw.fews.net/documents/documentlist/?format=json or https://fdwdev.fews.net/documents/documentlist/?format=json&page_size=X, and in addition to this , the documents can be extracted by using the
download_urlof these APIs.
Add Description to Data Series Search fields
This feature allows users to search based on the contents in the
Description fieldof the data series of all the data domains.
Bulk import feature for adding border towns to FDW
This feature is about implementing the bulk import functionality of the border points for the cross border trade data domain.
Consistent Y axis over time for Sub National Crop Production Dashboard
This feature is about making the Y-axis of both the map and the admin unit bar chart of the sub national crop production dashboard constant, which allows the user to more easily visualize the crop production data.
Standardize Geographic Unit and Indicator foreign keys to Data Series
This feature is about standardizing the Geographic unit and Indicator fields of the data series of all the Survey and Non-survey data domains.
Faster responses for paginated Crop Production API calls
This feature is about improving the response time performance of the paginated crop production indicator APIs.
Tasks
Support on troubleshooting IPC file data uploads
This task was about giving support to Early Warning team members on uploading the IPC FIC data domain and the data was successfully loaded.
Validate email addresses to ensure there is 1 address per 1 user
This task was about ensuring there is only one email address for a single user so that users are not getting duplicative emails from the system. (https://fdw.fews.net/en/admin/auth/user/add/).
Review of FDW Data Point API extract formats for Markets and Trade
This task was about reviewing the FDW Data Point API extract formats of the Markets and Trade data domains and as a result a spreadsheet which contains the recommended changes has been developed.
Incorporate Formatting Guidance into Price Charts
This task was about incorporating formatting standards for the Price Charts Dashboard (https://fdw.fews.net/dashboard/price/).
Bugs/Defects
Geography filter is not caching correctly
The geography filter of the Crop data domain was slow in loading the data values due to the caching issue and this was resolved and currently the filter data loads faster.
Clicking on the Help with the current page tab of each pages of the FDW results in 404 error
A 404 error page was shown when one clicked on the
Help with the current pagetab of each pages of the FDW and this was resolved & all pages are working correctly.
Investigate Data Domains filter behavior in Data Inventory dashboard
There was an issue in Data Inventory Dashboard filters i.e selecting data from the second filter (
Data usage policy)erased the filter data of the Data domains. This was resolved and the functionality is working well.
Unable to upload Cameroon shape file
There was a 500 Internal server error which was shown upon trying to upload the shape file of the country Cameroon and this was resolved and the shape file successfully loaded into the system .
Saving data set is not working at the subgroup level of the IPC FIC Data domain
There was an error upon saving data set for the IPC FIC data domain at the subgroup level and this was resolved and the functionality is working as expected.