An Overview of Geospatial Standards Support within the

An Overview of Geospatial Standards Support within the Arc. GIS Platform Satish Sankaran Marten Hogeweg

Agenda • Interoperability Challenges • Standards Organizations and Standards • Standards – Data formats and API, Metadata and Web Services • Arc. GIS – Standards Support • Pragmatic Interoperability (de-facto vs de-jure standards) • Demonstrations

Interoperability Challenges Web Mobile • • • Create Manage Visualize Analyze Collaborate Discover Desktop - Multiple Platforms ( Operating Systems, Databases, …) - Multiple Architecture ( Local, Enterprise, Web, Cloud, …) - Multiple Clients ( Desktop, Web, Mobile, …) - Multiple Developer Environments (. NET, Java, …) - Multiple Protocols (SOAP, REST, OGC, …. ) - Multiple Encodings ( XML, Raster Formats, GML, JSON, …. ) Cloud Enterprise Local

The Arc. GIS Platform - An Open & Interoperable Platform - - Supporting a thriving ecosystem of focused apps and applications. A Standards Compliant Platform - Supporting many relevant standards including those from ISO TC 211 and OGC. http: //www. esri. com/software/open

Developer Procurement personnel System Integrator User Standards ETL Open

Many Standards Organizations ……. ISO ANSI/INCITS IHO OMA OGC WS-I ACSM CEN FGDC OASIS GSDI DGIWG ASPRS EPSG

Many Standards …… WFS WMS ISO 19139 SOS WPS WCS ISO 19115 Geo. XACML FGDC - CSDGM Simple Features Open LS GML OWS Context City. GML Geopackage

GIS Standardization – functional areas Basic Geographic Structures (semantic interoperability) Geometry, topology, coordinate reference systems Content Description (semantic interoperability) Standardized Data Models, Feature Catalog Modeling languages, Application schemas Metadata Data Management (semantic and technical) Database management Data Formats (technical interoperability) Structure, Syntax, language, API Visualization (semantic and technical) Symbology, cartography, display Geo. Web Services (technical interoperability) Web Catalog, Web Services, SOA

GIS Standardization – functional areas Basic Geographic Structures ISO 19107 – Spatial Schema, ISO 19111 – Coordinate Reference Systems Content Description FACC, SDSFIE, Standardized Data Models ISO 19110 – Feature Catalog Methodology , UML, FGDC Metadata, ISO 19115 – Metadata Data Management OGC Simple Features Data Formats VPF, OGC GML, ISO 19139, 80+ industry and national formats Visualization SLD, MIL-STD 2525 Web Services OGC WMS, WFS, WCS, Open. LS Registry and catalog services CAT 1. 0, OAI-PMH, CS-W (eb. RIM)

Standards Data Formats Metadata Web Services

Data Formats • Simple Features • CAD formats • GML • IFC • KML • NIEM • Geopackage • …. . • Gml JPEG 2000 • OWS Context • Water. ML, Ai. XM, …

What are simple features? • Simple Feature specification defines: - Data access model Database schema - 2 D Geometry model for points, lines, polygons - “Well-Known” data formats for geometry and spatial reference - • ISO and OGC specifications for simple feature access Feature Tables contain rows (features) sharing common properties (Feature Attributes). Fea Geometry is a Feature Attribute. 10 area 1 yellow 11 area 2 green 12 area 3 Blue 13 area 4 red Geometry Feature Attribute Feature Table Feature

Geography Markup Language (GML) • GML or Geography Markup Language is an XML based encoding standard for geographic information developed by the Open Geospatial Consortium (OGC). • Defines an XML schema for representing geographic features (attributes, geometries, relationships, Topologies, Observations, etc). • GML Simple Features - Initially motivated to help WFS use of GML 3 - GML 3 has many optional elements of schema, which complicates GML parsers - GMLSF Profile “fixes” application schemas to only allow the elements prescribed in the profile - This allows WFS servers and clients to be simpler and more efficient; the types of data which they need to anticipate are finite and reasonably structured for faster parsing

GML Support in Arc. GIS • GML Support in Arc. GIS Desktop - Simple Feature GML support is available to all Arc. GIS users Import/export data - Use directly as a map layer - Use in a geoprocessing model - Consume GML served by any Web feature Service (WFS) - • GML Support in Arc. GIS Desktop (Arc. Map) using the Data Interoperability Extension - Support for specific Application schemas available using the Data Interoperability Extension. Several application schemas supported - Custom schemas defined using transformation tools - Consume GML served by any Web feature Service (WFS) - • GML Support in Arc. GIS Server – Web Feature Service (WFS) implementation - GML is streamed using the Web Feature Service Protocol

Kml Support in Arc. GIS KML is an XML grammar used to visualize geographic data in an earth browser. KML uses a tag-based structure with nested elements and attributes and is based on the XML standard. • Serve – Using Arc. GIS Server • Consume – Arc. GIS Desktop (Arc. Map, PRO) – Runtime – Arc. GIS Earth – Arc. GIS Online / Portal • Geoprocessing Tools – Layer To KML Tool • The Layer To KML geoprocessing tool allows individual • layers to be exported directly from Arc. Map, Arc. Globe or Arc. Scene. – Map To KML Tool • The Map To KML geoprocessing tool allows multiple layers to be • exported into a single KML source.

Arc. GIS Data Interoperability Extension • Format Support – Adds support for 200+ data formats – Custom Formats – Direct use in Arc. GIS Desktop • Quick Data Translation – Data Interoperability Tools Toolbox – Convert between data formats • Spatial ETL (Extract, Transform, Load) – Semantic Data Translation – Data Restructuring

Standards Data Formats Metadata Web Services

Metadata Leading the way to semantic interoperability • Data about data - • Geographic area covered Currency Rules of use • A Key interoperability technology: - Producers explain their product - Users learn about products Non standard products can be understood Positional accuracy Data dictionary International Metadata Standards • FGDC CSDGM - Means of encoding - Datum - Map projection • ISO 19115, 19119 Metadata • ISO 19139 Metadata XML Schema Implementation • …

ISO Metadata ( Today Future ) Ted Haberman : hdfcgroup. org

Metadata standards today Extensions Content Standard for Digital Geospatial Metadata Aka “FGDC Metadata” Profiles ISO 19115 Geospatial Information - Metadata Aka “ISO Metadata” <xsd: element name="bounding" type="bounding. Type"/> <xsd: complex. Type name="bounding. Type"> <xsd: sequence> <xsd: element ref="westbc"/> <xsd: element ref="eastbc"/> <xsd: element ref="northbc"/> <xsd: element ref="southbc"/> </xsd: sequence> </xsd: complex. Type>

Overview of Metadata Standards

ISO 19115 (-1) Profiles • Australia-New Zealand Profile • North American Profile of ISO 19115: 2003 (NAP) • • • CAN/CGSB-171. 100 -2009 • INCITS 453 -2009 INSPIRE Metadata Directive ISO 19115/ISO 19119 Application Profile for CSW 2. 0 C 3 Grid ISO 19115 Metadata Profile Marine Community Metadata Profile of ISO 19115 Energy Industry Profile of ISO 19115 -1 USGIN ISO 19139 Profile DISDI Geospatial Metadata Profile (DGMP) National System for Geospatial Intelligence Metadata Foundation (NMF) • • • • A metadata profile for precision agriculture based on ISO 19115 standard. WMO Core Profile of the ISO 19115 Metadata Standard Transformation of HDF-EOS metadata from the ECS model to ISO 19115 -based XML Draft African metadata profile of ISO 19115 Samoan profile NOKIS – an ISO 19115 Based Metadata System The UDK and ISO 19115 Standard Latin American Profile Núcleo Español de Metadatos (NEM) UK GEMINI Biological profile Coastal zone profile S 100 Metadata profile (IHO)

Arc. GIS Metadata Standards Support Arc. GIS Metadata ISO 19139 (NAP) XML ISO 19139 (INSPIRE) XML FGDC CSDGM XML ISO 19139 XML

Arc. Catalog

Metadata Arc. GIS Is a Platform Enabling GIS Everywhere Desktop Web Device Simple Integrated Author / Create Use Web GIS Open Portal Catalog / Discover / search Serve / Publish Server Online Content and Services Available in the Cloud. . . and On-Premises

Arc. GIS Platform and Metadata Items Carrying Metadata Indexing / Access / Discovery • Portal and Online Items • Geo. Services REST Spec • Mxd’s, Datasets, Services • Open. Search • Folders • OGC CS-W • … Metadata Formats Products • Item Information Arc. GIS Desktop – Arc. Map, PRO • Arc. GIS Metadata Arc. GIS for Server • Formal Metadata – FGDC, ISO, … • DCAT • Encodings – esri JSON, XML, atom, Arc. GIS Online / Portal for Arc. GIS Open. Data App Geoportal Server App Widgets

Esri support for metadata Arc. Map Geoportal Item Info Arc. GIS Online Mxd properties Arc. GIS PRO Arc. GIS service meatadata Service Metadata Arc. GIS Open. Data WMS metadata

What’s Next for Arc. GIS? • • Investigating how to incorporate support for ISO 19115 -1/19115 -3 into the Arc. GIS platform - 19115 -3 incorporates existing ISO 19115 -2 and 19110 XML schemas - Evaluating XML schemas available in new ISO repositories Continue to Improve metadata support in Arc. GIS Pro and throughout the platform - Desktop -> Server -> Online/Portal - Planning next steps

Standards Data Formats Metadata Web Services

OGC Web Services • Web Map Service • OGC KML • Web Map Tiling Specification • Sensor observation Service • Web Feature Service • Web Processing Service • Web Coverage Service • 3 D Portrayal service • ….

DGIWG and OGC Service Types and Profiles Geospaial Interoperability Reference Architecture doc Report – Spring 2015 https: //www. ise. gov/sites/default/files/GIRA. pdf http: //ise. gov from … Geospatial Interoperability Reference Architecture (GIRA)

Arc. GIS Platform Components Portals (AGOL, Portal) Providing & Consuming Server Providing Developer Solutions (runtime, Javascript Api) Consuming Core Standards Metadata (ISO, FGDC, …) Data (Geopackage, geo. JSON, gml. JPEG 2000…) Desktop (Arc. Map & PRO) Consuming Portrayal Standards Apps Consuming Services (wms, wfs, wcs, wps, sos, cs-w, …)

JSON clients OGC clients (HTTP REST) (HTTP SOAP) Inspire CSW Arc. GIS for Inspire Geoportal Inspire WFS Inspire ATOM Inspire WMS WPS WCS WFS WMTS WMS KML Geo. JSON Esri REST API Arc. GIS for Server Inspire clients http: //www. esri. com/library/whitepapers/pdfs/supported-ogc-iso-standards. pdf

Standards Requirements – Across the platform …. . What we are hearing! • Online / Portal - Register OGC services - Consume OGC services Create hosted OGC services Geopackage support Allow analyses on OGC services Support Discovery Standards – OGC CSW, Open. Search, DCAT Managing Secured OGC Services • Metadata Support across the platform • Federated searches across portals • Server - • Improve existing OGC support ( compliancy, update to new version, new profiles) Desktop (Arc. Map / Pro) - Consume OGC services - Geopackage support • Runtime and Apps - Consume OGC services - Geopackage support • Javascript API - Consume OGC services

Standards Support • • Arc. GIS Online • Arc. GIS PRO - Support formal Metadata (Version 3. 8, July 2015) - Improvements to wms wmts and metadata support in PRO (PRO 1. 2) - Support for secured OGC services (Version 3. 10, Nov 2015) - Improvements to KML support ( Pro 1. 3) - Major improvements in Online (version 4. 2, June 2016 ) – wms, wfs Arc. GIS for Server - Improvements to wfs 2. 0 support - Achieved KML Compliancy (Server 10. 4) • Arc. GIS Earth 1. 1 - Supports kml, wms and wmts

Standards Support - Roadmap Support for Hosted wms, wmts and wfs support in Online (Q 4 2016) and Portal ( Version 10. 5) WCS support in Javascript API (prototype) Native wfs client support in PRO (Version 1. 4) Web App Builder widget to consume OGC OWS context document with embedded ogc services (prototype) WCS 2. 0. 1 support in Arc. Map and PRO Support for wms, wmts ( Q 4 2016 Quartz runtime) Support for geopackage, wfs , s 57 in (Q 1 2017 Quartz runtime) Native net. CDF Support in Arc. Map (10. 5) and PRO (10. 4) Better metadata support across the stack Improvements to geopackage support

Procurement personnel http: //www. opengeospatial. org/resource/products/compliant#ESRI @ 10. 4 : 16 certificates

Pragmatic Interoperability SOA Vs REST Use the Web Luke ! http: //www. programmableweb. com/news/api-anti-patterns-how-to-avoid-common-restmistakes/2010/08/13 http: //geekandpoke. typepad. com/. a/ 6 a 00 d 8341 d 3 df 553 ef 012875 f 312 f 9970 c-pi …. Some GIS Standards are still playing catchup with the Web

Pragmatic Interoperability Standards, Specifications, …. • geo. JSON • geo. RSS • • DCAT / geo. DCAT -AP • CSS – Styling • RDF • No SQL • xlsform Atom Sqlite Vector tiles • Opensearch + geo. Extension

Pragmatic Interoperability Open API’s and Specifications • Shapefile (July 1998) • i 3 S • Geodatabase XML (June 2008) • LERC • Geo. Services REST API (Sept 2010) • FGDB API (Jan 2011) (May 2015) (Dec 2015) Open Data Download Stats for April 2016 Shapefile: 3, 714, 978 CSV: 413, 037 Geo. JSON: 318, 052 KML: 43, 689 Geo. Hash: 22, 033

The Proof of the Pudding… @martenhogeweg

Group on Earth Observations SAEOS INPE PANGAEA GCMD Arc. GIS Online GEO Sea. Data. Net EEA-SDI Euro. GEOSS WMO WIS IOOS Enviro. GRIDS GSFC-DAAC GBIF

Connecting GIS and Earth Observations

Geospatial Platform and Data. gov … NASA GSA FCC Census Geoplatform. gov Data. gov DOI DOT NOAA DOJ EPA DHHS DHS

Access Geoplatform Content in Arc. GIS • Connect to http: //geoplatform. maps. arcgis. com • Find National Geospatial Data Assets • Use in Your GIS Projects

OGC Testbed 12 • • • Viewer - Arc. GIS, WMS, WCS, KML - WMTS, Koop Feature. Server Discovery - Open. Search - OGC CSW 2. 0. 2, 3. 0. 0 OGC Context Document - Geo. JSON encoding

Please take our Survey Your feedback allows us to help maintain high standards and to help presenters Find your event in the Esri Events App Find the session you want to review Scroll down to the bottom of the session Answer survey questions and submit