UN Open GIS Initiative November 11, 2016 Kyoung‐Soo Eom, UN (
[email protected]) Ki‐Joune Li, Pusan National University, Korea (
[email protected]) Anthony Calamito, Boundless, USA (
[email protected]) Diego Gonzalez Ferreiro, UN (
[email protected]) Maria Brovelli, Politecnico di Milano, Italy (
[email protected]) Hae‐Kyong Kang, KRIHS, Korea (
[email protected])
November 11, 2016
UN Open GIS Initiative
2
Empower everyone with open source geospatial
UN Open GIS Initiative To Unite Our Strength without Barrier
November 11, 2016
UN Open GIS Initiative
3
Open Source as an International Machinery
Equal Technology
Collaboration
Technology Transfer
Technology Progress
Open Source Software as a Platform
November 11, 2016
UN Open GIS Initiative
4
UN Global Service Centre, Brindisi, Italy. 7‐11 March 2016 November 11, 2016
UN Open GIS Initiative
5
A Basic Understanding on UN Open GIS • UN is a International Organization, which functions like government • UN GIS as a National Spatial Data Infrastructure (NSDI) • NSDI
Framework(Base and Reference) Map System and Services Capacity Institutional Arrangement Standards
November 11, 2016
UN Open GIS Initiative
6
Goal and Scope of UN Open GIS Initiative
NSDI Solutions
1. System and Services 2. Capacity Scope of UN Open GIS
November 11, 2016
UN Open GIS Initiative
7
What is the UN Open GIS Initiative? Goal To identify and develop open source GIS software that meets the requirements of UN operations, taking full advantage of the expertise of mission partners. ‐ from UN Open GIS Strategy Manifesto
Current Members Members UN
Contributions
US DoD, NGA
Strategy, Requirement Analysis, Deployment, Assessment, Maintenance Geo‐Portal (GeoSHAPE/Exchange), Training Support
KRIHS, Korea
Geo‐Analysis, Geospatial Data Collection (OpenGDS)
GeoSDI, Italy
Geospatial Applications and Services (GeoSDI)
OSGeo GeoForAll
OS Knowledge, Documentation, Technical supports Technical Supports, Education
+ November 11, 2016
UN Open GIS Initiative
8
UN Open GIS Initiative Structure UN Contributing Bodies
Strategic Board
Co‐Chairs Secretariats
Technical Advisory Group
Requirement Advisory Group Assessment Team
Spiral One (Geo‐Portal)
Spiral Two (Capacity Building)
Spiral Three (Geo‐Analysis)
Spiral Four (Data Collection)
Why Called Spiral? ‐ Incremental Approach
November 11, 2016
UN Open GIS Initiative
9
1. Data Collection
4. Geospatial Services
Enterprise GIS 2. Geospatial Data Management
3. Geospatial Analysis
November 11, 2016
UN Open GIS Initiative
10
• Challenges – UN NSDI
Very Diverse and Complex Tasks Ad‐Hoc Development of GIS applications Fragmentation SaaS PaaS DaaS IaaS
November 11, 2016
UN Open GIS Initiative
11
SaaS
OS Spatial Analysis/ Map Publication
OS Geo‐Portal: Imagery and Vector (2D/3D)
PaaS
OS GIS Solution for Data Collection
S/W Sharing
Function Sharing Geospatial Server and Spatial DBMS
DaaS
IaaS
November 11, 2016
Data Sharing
UN Data Center
UN Open GIS Initiative
Infrastructure Sharing
12
Capacity for ‐ Service Developments ‐ Supporting Requests from Fields ‐ Maintenance ‐ Technology Transfer to Developing Countries ‐ Technology Evolution
Geoforall.org
Individual Capacity Institutional Capacity
November 11, 2016
UN Open GIS Initiative
13
Approach Covering the lifecycle
Enterprise GIS
Ad‐Hoc Development
Geo‐Cloud Computing
Cost
Open Source GIS
Migration
Gradual Migration and Hybrid Structure
Capacity Building
OS Capacity Center
November 11, 2016
UN Open GIS Initiative
14
Roadmap UN Capacity
Development Phase ‐ Fundamental Setting
IOC(Initial Operating Capability) Implementation Phase ‐ Solution Delivery
Sustainment Phase ‐ Sustainable Capacity
Phase 1 2016
November 11, 2016
Phase 2 2017‐2018
UN Open GIS Initiative
Phase 3 2019‐
Time
15
Roadmap – Three Phases 1. Maintenance 2. Development of New Services and Functions 3. Transfer to 3rd Parties
Sustainable Capacity Solution
Requirement Analysis
Development and Delivery of Solution
System Infrastructure System Infrastructure Deployment
Training
Training Structure Setting‐Up
Governance
Governance Structure Setting‐Up
Training and Capacity Building
Capacity Building Center
Phase 1 Phase 2 Phase 3 Development Phase Implementation Phase Sustainment Phase ‐ Fundamental setting ‐ Solution Delivery ‐ Sustainable Capacity
November 11, 2016
UN Open GIS Initiative
16
Spirals • Spiral One Goal – to provide a Geo‐Portal and setup a geospatial information infrastructure in UN Led by Anthony Calamito from Boundless Base Open Source Software – GeoSHAPE‐Exchange
• Spiral Two Goal – To assist capacity building for the UN by several training programs Led by Maria Brovelli and Diego G. Ferreiro
• Spiral Three Goal – to provide geo‐analysis solutions for UN Led by Hae‐Kyong Kang Base Open Source Software – OpenGDS/Analysis
March 10, 2016
UN Open GIS Initiative
17
Architecture ‐ Overview
UN Open GIS Solutions
Data Capture
PC GIS BI Solutions Ready to Use
Geo‐Visualization
Geo‐ Analysis (SP3)
Geospatial Clients
OGC Standards
OGC Standards
Geospatial Server
Tracking and Sensor Geo‐Analysis
Geo‐ Portal (SP1)
Data Collection (SP4)
GeoSHAPE/Exchange (SP1)
UN Data Center November 11, 2016
UN Open GIS Initiative
18
Spiral 2 - Capacity Building Maria Antonia Brovelli(*) and Diego Gonzalez (**) (*) OSGeo/GeoForAll Politecnico di Milano (**) UN
Spiral 2 steps Date
Official Announcement
7/3/2016 11/3/2016
Kick-off workshop in Brindisi
9/3/2016
24/3/2016 6/4/2016
Sharing the UN Workshop GeoforAll presentation http://www.slideshare.net/mariabrovelli/geoforall-asuccessful-osgeo-initiative GeoForAll Call for UN training material GeoForAll Call for Contributions for revision
6/7/2016-2/8/2016
Survey provided to UN staff asking about their exigencies
19/9/2016 19/10/2016
First course, first edition: QGIS GeoAcademy First course, second edition: QGIS GeoAcademy
9/01/2016
Second course: PostGIS Boundless
Survey • Divided in three main parts:
About the staff member
About the staff's knowledge of Open Source GIS
About the staff's preferences on training modalities
• It was opened for about a month: 6th July to 2nd August
Summary about the survey
OS vs Proprietary Software comparison. OS only wins in Customization, Open Standards and Overall Costs. Knowledge of software. The best known are the usual suspects: QGIS, PostGIS, GeoServer, OpenLayers
Only 2 respondents have claimed to have official training on OS
Priority for training: Desktop and database are on top.
Vast majority of people prefer on-site instructor-led training and intensive course for 2-3 days. The courses should have an exam at the end according to most of the participants.
Collection of potential online training material • https://wiki.osgeo.org/wiki/UNTraining • • • • • • • •
1 QGIS 2 gvSIG 3 GRASS GIS 4 GeoServer 5 OpenLayers 6 PostgreSQL 7 PostGIS 8 GeoGig
9 GeoNode 10 Rasdaman 11 OSGeo-Live 12 Bringing GEOSS services into practice 13 GeoMOOSE 14 GET-IT 15 Open Source Geospatial Notebooks 16 Developing Training Material
Online training
QGIS GeoAcademy Tutors
Exam and certificate
What's next? PostGIS (January 2017) ● Geonode ● Geoserver ● Openlayers ●
On-site instructor-led training? ● Preparing new ad-hoc courses? ●
Keep in touch with us!! https://wiki.osgeo.org/wiki/UnitedNations_Committee
Spiral 3: Geo Analysis
2016.11.10 Friday
Spiral 3 Members Organization
Name
UN GSC
Cung Thang
Co‐Leader
Chief, Geospatial Analysis Unit, GIS‐SGITT Aeroporto Militare "O. Pierozzi" Piazza Del Vento, 72100 Brindisi, ITALY Ext: 158‐6195 Tel: +39 0831056195 Email:
[email protected]
OpenGDS
HaeKyong Kang
Co‐Leader
Research Fellow, Geographic Information Research Division, KRIHS 431‐712, 254 Simindae‐ro, Anyangsi, South Korea H. +82 010 2033 5998 T. +82 031 380 0405 Email:
[email protected] Skype: somakang1
OpenGDS
Minpa Lee
Key‐Architect
Director of R&D Mango System inc. Mail :
[email protected] Mobile : 010‐2030‐7084 Blog : http://onspatial.com
UN
Thinley Wangdi (TBD)
OpenGDS
Ji‐Hyun Kim
Mango System inc.
[email protected]
OpenGDS
GwangWoo Nam
Professor
OpenGDS
Ki‐Joune Li
Professor and Co‐Chair of UN Open GIS Initative Pusan National University
Source. Ki‐Joune Li. August 30 2016. UN OpenGIS Strategic Board Meeting – Review Session. P14.
Remind •
Outcomes : “Agree that Spiral Two will focus on geospatial analysis functions”. (p5)
•
Spiral Two: Geospatial analysis (p7) ‐
Once Spiral One is underway, the following development will benefit from lessons learnt and will be guided by technical choices made for Spiral One.
‐
(Process) The terms of development of this phase will be described at a later stage but the implementation process should be similar to the one for Spiral One, including technical and operational validation before a UN final decision.
‐
(Preparation) This second spiral might require more development than Spiral One as all the open source components might not be immediately available.
‐
(Preparation) The project board will review existing and available components before implementing the second spiral.
‐
(Approach) It will also be crucial to continue considering the hybrid approach and the business continuity in this phase of the project.
‐
(Lead) The lead agency will be the Korea Research Institute for Human Settlements (KRIHS) and the UN mission remains to be determined.
Remind Professor Ki‐joune Li’s Presentation (2016.3.9)
Progress Report
[Requirement Analysis of Spiral Three : GeoAnalysis] • 4 April 2016 (Mon) Chung Thang (GSC) requested to share GIS analysis tools
demonstrated in Brindisi during conference to Mr. Lim
• 7 April 2016 (Thurs) Mr. Jihyun Kim/Mr. Minpa Lee sent an URL of the demo site and
Github as its source code repository Demo Site : http://mango.iptime.org:58088/wpsol3/ Github Repository : https://github.com/mapplus/spatial_statistics_for_geot ools_udig GeoServer WPS Document : http://docs.geoserver.org/stable/en/user/extensions/w ps/index.html
Progress Report: Requirement from GSC
• 27 April 2016 (Wed) Remind the demo site and user requests (KRIHS Chung)
• 28 April 2016 (Thurs) Chung Thang (GSC) replied: ….Our team assessed them and look forward to apply in our web mapping services based on ArcGIS environment. As of now, we would like to have the following analysis tools useable in our web map services. 1. 2. 3. 4.
Vector Overlay Analysis Multiple Ring Buffer Point Cluster & Spatial Clump Time Series Animated widgets
For UN Open Geospatial Spiral Two, we will compile a list of analysis tools to be in GeoSHAPE. We are also interested in image enhancement tools for raster data analysis.
Progress Report: Requirement from GSC
• 12 May 2016 (Thurs) Chung Thang (GSC) gave detail requests
The following list is the analysis tools we would like to have. In general, using these analysis tools, we would like to perform fairly complex analysis such as monitoring and assessment (flood modeling, change detection), suitability analysis (site selection, helicopter landing zone), network analysis (routing), querying analytic results, etc.. In fact, it would be good to have all 171 WPS processes listed at MANGO system made available for upcoming GeoSHAPE.
9
Review results of UN Requests No.
Analysis Function
1
Summarise Data
2
Find Locations
3
Data Enrichment
4
Analyse Patterns
5
Use Proximity
6
Manage Data
Tool Aggregate Points Summarize Nearby Summarize Within Find Existing Locations Derive New Locations Find Similar Locations Choose Best Facilities Create Viewshed Create Watersheds Trace Downstream Enrich Layer Calculate Density Find Hot Spots Interpolate Points Create Buffers Create Drive‐Time Areas Find Nearest Plan Routes Connect Origins to Destinations Extract Data Dissolve Boundaries Merge Layers Overlay Layers
Reference ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online ArcGIS Online
Applications
OpenGDS
● ● ● ● ●
● ● ● ●
Review results of UN Requests
7
Spatial Analysis
8
Map Enhancement
9
Raster tool
Buffer analysis Dissolve Union Merge Centroids and centers Joins Aggregation & statistics functions Triangulated irregular networks Interpolation Concave and convex hulls Simplify features Filter / select by attribute Data classification Grids Distance calculations 2D Histogram Adjacency Matrix Circular Brush Contour plot Color wheel Force‐directed labels
Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box Map Box GitHub ?? GitHub GitHub GitHub GitHub GitHub
Geometric primitives, labels, connections
GitHub
Hexagonal binning Horizon chart Icon array Rollup (PivotGraph) layout Clipping Surface Analyses Masking Composite bands Zonal Statistic Distance analysis Interpolation
GitHub GitHub GitHub GitHub
● ● ● ● ● ● ● ● ● ● ● ● ● ● ●
●
● 2018 2018 2018 2018 2018
Scope of OpenGDS ‐ GeoAnalysis
Scope of OpenGDS ‐ GeoAnalysis Development Scope by OpenGDS (Mango System)
Desktop Processing Plugin
Geo Analysis Desktop Plugin Processing Toolbox
uDig Desktop
Scripting & Modeler Widget & Dialog
GeoServer WPS extension Based on Spring Framework GeoServer
Graph & Utilities I18n & Repository Geo Analysis Server Plugin WPS Services
Geo Analysis Library
Process Parameter IO
GeoTools
Geo Analysis Engine Process & Process Factory Spatial Statistics Operation
Existing Open GIS SW
140 kinds New-Development
Vector & Raster Operation Style & Transformation I18n & Storage
License Respect the license of original Open Source SW
Products
Original License
License
GNU LGPL v2.1 - gt-main (BSD License) GeoTools
- gt-xsd-core (Apache License)
GNU LGPL v2.1
- gt-brewer (Apache License) - gt-referencing3d (partly NASA) GeoServer
GNU GPL v2.0
GNU GPL v2.0
uDig
EPL v2.0/BSD v1.0
EPL v2.0/BSD v1.0
40
140 functions
Progress Report of Sprial Three :
[Requirement Analysis of Spiral Three : GeoAnalysis] • 13 May 2016 (Fri)
Korean Team reviewed the list of functions. Wait till the architecture of Spiral One will be completed. Communicate on APAN to share a progress with all.
• Spiral Three Board (May 2016)
Cung Thang(Geospatial Analysis Unit, GIS‐SGITT) Timur from UN Mr. Jihyun Kim, Mr. Minpa Lee (Mango System Ltd) HaeKyong Kang (KRIHS) Ki‐Joune Li (Pusan National University) Maria
• 12 Aug 2016 Reported
Progress Report of Sprial Three :
Future plan
Co‐leader will be Cung Thang (UN USG) Analysis user requirements Decide development environment by consideration SI with Sprial 1. i.e. OS, Compile Language & version, etcs. Analysis user‐requests to design algorithm
Sprial 3 Governance
Leader, Co‐Leader
Technical Advisors
Developers
2. UN Requests and review results OpenGDS team needs additional information such as {datasets, analysis flows, primitive functions} for each Geo‐Analysis function in current UN system. i.e. helicopter landing zone analysis {Input Dataset(DEM, POIs), AnalysisFlow for Potential Landing Zone, ...} * Analysis Flow for PotentialLandingZone Step1: a set of Potential_Landing_Zone = Function1 ( Slob<10% &&Elevation<11,000' && No Open Water && No Forest && No Brush) Step2: a Potential_Landing_Zone = Function2 (step 1 with at least three Contiguous Surrounding Cells with allowable canopy clearance) Step3: ....etcs.
Sep. 26 2016
3. Future Plan
Functions, Datasets, Analysis flow UN GSC
OpenGDS
GeoShape
2016.11.10 • Kais Zouabi will design UN application for GeoAnalysis.
Sprial 4: • 기욤 & 디에고 in charge of generalization
Unite Our Strength!
http://unopengis.org will be available soon November 11, 2016
UN Open GIS Initiative
49