Introduction
Dated: 13 February 2020
In this sprint release document, the features and defects below have been resolved and deployed to the production FDW/FDE server.
- 
  Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46 
- 
  Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94 
- 
  Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96 
- 
  Support GeoJSON format extracts in DataPoint APIs https://fewsnet.atlassian.net/browse/DATA-130 
- 
  Implement an OpenAPI Schema to make it easier to use the REST API https://fewsnet.atlassian.net/browse/DATA-134 
- 
  Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136 
- 
  Associate the document type based permissions to the FEWS NET Staff and FDE Only roles https://fewsnet.atlassian.net/browse/DATA-145 
- 
  Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149 
- 
  Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155 
- 
  Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170 
- 
  Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed https://fewsnet.atlassian.net/browse/DATA-180 
- 
  Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80 
- 
  Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146 
- 
  Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156 
- 
  In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166 
- 
  Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173 
 
  
  
   New Features            
 
  
  
  Improved performance for refreshing the Data Point Facts materialized view https://fewsnet.atlassian.net/browse/DATA-46     
- 
  This feature is about making change on a `warehouse_datapointfacts_view` so that it excludes Data Points that are Crop Production Indicator Values (using the specialization_type) and checks on the difference in time to refresh the view before and after the change, which as a result improves performance for refreshing the Data Point Facts materialized view.
 
  
  
 Searching for Exchange Rates by Country Name https://fewsnet.atlassian.net/browse/DATA-94      
- 
  This feature is about allowing users to search the exchange rate by country name and in addition, the calculated name of the exchange rate data series has also been changed to include `from_currency_iso_en_name` and the `to_currency_iso_en_name` as shown below: 
 
  
 
  
  
  Separate Border Point from Market https://fewsnet.atlassian.net/browse/DATA-96     
- 
  This feature is about separating the Border Point value from the Market, i.e the Border Point becomes a separate list under the sub-class of the Geographic unit like shown below: 
 
  
 
  
  
 Support GeoJSON format extracts in DataPoint APIs  https://fewsnet.atlassian.net/browse/DATA-130
- 
  This feature is about implementing GeoJSON format extracts in DataPoint APIs, which as a result, will be used in GIS tools for generating Maps, etc. 
 
  
  
 Implement an OpenAPI Schema to make it easier to use the REST API  https://fewsnet.atlassian.net/browse/DATA-134
- 
  This enhancement is about implementing an OpenAPI Schema to make it easier for users who wish to make API requests to use the REST API. 
 
  
  
 Improve speed of FDE tables, maps and charts by only extracting required fields https://fewsnet.atlassian.net/browse/DATA-136
- 
  This feature is about improving the speed of FDE tables, maps and charts by only extracting the required fields. 
 
  
  
 Associate the document type based permissions to the FEWS NET Staff and FDE Only roles  https://fewsnet.atlassian.net/browse/DATA-145
- 
  This enhancement is about associating the document types to the Groups of FDE Only&FEWS NET Staffso that the users which are assigned to the groupFDE Onlycan access only the documents which they are allowed to access and can only view theData Explorer, whereas the users which are assigned to the groupFEWS NET Staffmay access all the total documents and can also access/view theData Explorer & Data Management.
As a FDE Only user
 
  As a FEWS NET Staff user
 
  
 
 
  
  
 Update Mayan to 3.3 https://fewsnet.atlassian.net/browse/DATA-149
- 
  This task is about upgrading Mayan to 3.3 and this upgrade introduced key major changes in the user interface of the Mayan system by introducing the features listed below: - 
    Increasing the role label field size from 64 to 128 characters 
- 
    Darkening content area when opening the mobile menu 
- 
    Hiding the multi-item selection help text on mobile screens 
- 
    Removing body spacer HTML and JavaScript. Not needed with the new UI 
- 
    Adding support for icon shadows 
- 
    Back porting the vertical main menu update 
- 
    Adding support for menu inheritance 
- 
    Converting document image cache to use file cache manager app. Added setting DOCUMENTS_CACHE_MAXIMUM_SIZE defaults to 500 MB 
- 
    Using timezone aware date for document statistics 
- 
    Updating mayan_statistics migration 0002 to rename duplicate slugs 
- 
    Removing index create permission as an ACL permission for indexes 
 
- 
    
 
  - 
  The upgrade also resolves the bugs listed below: - 
    Username color on mobile screens not being user friendly 
- 
    The Mayan statistics app that fails to render correct value when the current month is December 
 
- 
    
 
  
  
 Upgrade Pandas to 0.23.4 https://fewsnet.atlassian.net/browse/DATA-155
- 
  Since FDW depends on the Pandas library to perform statistical calculations and data re-sampling and we were using version 0.22 which is very old. So this task upgraded Pandas to 0.23.4, which is a much more modern version. 
 
  
  
 Price Saved Data Sets screen doesn't show FEWS NET Only "tab" https://fewsnet.atlassian.net/browse/DATA-170
- 
  This feature is about adding the FEWS NET onlyvisibility option to a saved dataset of all the data domains of the FDE.
 
  
 
  
  
 Ag datasets marked "FEWS NET Only" should be "Public". 4 still need to be changed  https://fewsnet.atlassian.net/browse/DATA-180
- 
  There were crop datasets which were sourced from the Public, but these datasets had the visibility type of ‘FEWS NET Only’ so this task was to change these datasets to the ‘Public’ visibility type. 
 
  
  
 Resolved Defects                                         
 
  
  
 Fix Admin Unit Generation Issues https://fewsnet.atlassian.net/browse/DATA-80  
- 
  For about 41 countries the FNID codes of the Admin 0 units were missing the year component and it is now resolved for all of these countries. 
 
  
 
  
  
 Correct Mayan database credentials https://fewsnet.atlassian.net/browse/DATA-146
- 
  Due to a configuration error at the time of migration to the FEWS NET AWS infrastructure, the fdwdev and fdwprd environments were both sharing the same Postgres database and it is resolved now. 
 
  
  
 Cached Geography Filter for Crop Production tab in FDE is not working https://fewsnet.atlassian.net/browse/DATA-156
- 
  On Crop data domain, the Geographic filter took longer time to popup its values than it should have, and now the performance has been improved to be more consistent with the other geographic filter values' performance. 
 
  
 
  
  
 In the crop data domain, Admin units of the country Brazil are shown under the drop down list of International https://fewsnet.atlassian.net/browse/DATA-166
- 
  Admin 3 units of some countries were shown as list of countries under both M49 or FN Regions, which was incorrect, and this has been resolved. 
 
  
  
 Incomplete form in offline Data Upload admin screen https://fewsnet.atlassian.net/browse/DATA-173
- 
  There was an issue on the data upload page, i.e when one clicks on the Add data uploadbutton it results in the screenshot below. Users were unable to select theFile,Import format,subtype, and theFilefield were hidden like you see in the screenshot below, and this was resolved so that the fields are now selectable.
 
  
 
 
 
 
 
 
