Arc GIS Data Reviewer An Introduction Chandan Banerjee

Arc. GIS Data Reviewer: An Introduction Chandan Banerjee Jay Cary

Workshop Agenda • Importance of Data Quality • What is Arc. GIS Data Reviewer? • Automated review • Semi-automated review • Managing errors and reporting data quality • Summary/Resources Arc. GIS Data Reviewer: An Introduction

Importance of data quality Arc. GIS Data Reviewer: An Introduction

Defining quality A business perspective • • • Executive - Confidently make decisions - Reduce financial risk - Optimize organizational performance Manager - Effective data stewardship - Drive increased usage - Maximize productivity Knowledge worker - Increased efficiencies - Confidence in GIS Arc. GIS Data Reviewer: An Introduction

Defining Quality A Technical Perspective Spatial Accuracy Thematic Accuracy Completeness Logical Consistency Temporal Quality Usability ISO-19157: 2013 Geographic information – Data quality Arc. GIS Data Reviewer: An Introduction

Data quality management Capabilities of the Arc. GIS Platform Geodatabase integrity • • Schema constraints Geoprocessing tools Data load checks Versioning Advanced data types Arc. GIS Data Reviewer • Automated review • Semi-automated review • Error management • Quality reporting • Topologies • Geometric networks Arc. GIS Data Reviewer: An Introduction

What is Arc. GIS Data Reviewer? Data Quality Management for Arc. GIS • • • Provides - Rule-based validation - Interactive tools - Track errors Validate For individuals and enterprise - Saves time/money - Less rework For multiple domains - Configurable - Extendable Summarize Review Arc. GIS Data Reviewer: An Introduction

Managing Quality Control Processes Semi-automated Review Quality Reporting Automated Reviewer Results Arc. GIS Data Reviewer: An Introduction

What is Arc. GIS Data Reviewer? Data quality management in the Arc. GIS platform • Data Reviewer for Desktop - Arc. Map - Arc. GIS Pro Desktop Web Device Web GIS • Data Reviewer for Server - • Standard or higher Arc. GIS Online Portal Data Reviewer API for - FLEX - Java. Script Server Online Content and Services Arc. GIS Data Reviewer: An Introduction

Automated Review Arc. GIS Data Reviewer: An Introduction

Types of quality control Automated review Fast Consistent and repeatable Objective 100% coverage Arc. GIS Data Reviewer: An Introduction

Defining Quality Sources of data quality requirements Industry standards / Specifications Subject matter experts Training and experience Quality assurance plans Arc. GIS Data Reviewer: An Introduction

Automating Data Validation • Implementing quality requirements - 40+ configurable checks - Attribute - - Spatial relationships Feature integrity - - Feature and table values Collection rules Metadata - Completeness/Content http: //j. mp/DRCheck. Poster Arc. GIS Data Reviewer: An Introduction

Demo: Getting Started with Automated Review Arc. GIS Data Reviewer: An Introduction

Demo Scenario • Department plans to use field staff with field data collection devices to map road-related features (signs, street furniture). • Goals - Features should be positionally accurate based on siting criteria - Key attributes are populated and have the correct values - All features should be collected within the survey area Arc. GIS Data Reviewer: An Introduction

Authoring Data Quality Rules Arc. GIS Data Reviewer: An Introduction

Batch Validation Implementing Cumulative Review • Reviewer Batch Jobs - Define and encapsulate quality requirements - Captures domain knowledge - Designed once and executed many times - Arc. GIS for Desktop, Arc. GIS for Server Industry standards / Specifications Subject matter experts Training and experience Quality assurance plans Arc. GIS Data Reviewer: An Introduction

Resources Esri Solutions • Industry templates - Address Management - Basemaps - Electrical Utilities - Gas Utilities - Roads & Highways - Tax Parcel Editing - Water Utilities • Based on Esri industry models • Use as Starting point solutions. arcgis. com Arc. GIS Data Reviewer: An Introduction

Demo: Authoring Data Quality Rules Arc. GIS Data Reviewer: An Introduction

Authoring Batch Jobs Tips and Tricks ü ü Create sample data for testing Configure and execute from Reviewer Toolbar Leverage Mini-Browser to assess results Validate a pilot area with known issues Arc. GIS Data Reviewer: An Introduction

Executing Automated Validation Arc. GIS Data Reviewer: An Introduction

Methods for executing data validation Execute data validation using • Arc. Map Arc. GIS Data Reviewer: An Introduction

Methods for executing data validation Execute data validation using • Arc. Map • Arc. GIS Pro w Ne Arc. GIS Data Reviewer: An Introduction

Methods for executing data validation Execute data validation using • Arc. Map • Arc. GIS Pro • Model/Python script Arc. GIS Data Reviewer: An Introduction

Methods for executing data validation Execute data validation using • Arc. Map • Arc. GIS Pro • Model/Python script • Arc. GIS Workflow Manager Arc. GIS Data Reviewer: An Introduction

Methods for executing data validation Execute data validation using • Arc. Map • Arc. GIS Pro • Model/Python script • Arc. GIS Workflow Manager • Arc. GIS for Server Arc. GIS Data Reviewer: An Introduction

Demo: Executing Automated Validation Arc. GIS Data Reviewer: An Introduction

Batch validation Events when validation may be required ü ü Before data loading During editing Prior to sharing/publishing maps Prior to rolling-out new applications Arc. GIS Data Reviewer: An Introduction

Semi-Automated Review Arc. GIS Data Reviewer: An Introduction

Types of quality control Automated Semi-automated review Fast Guided Workflows Consistent and repeatable Streamlined processes Objective Subjective 100% coverage Sampling Arc. GIS Data Reviewer: An Introduction

Semi-automated review methods Visual review • Redlining • Systematic review • Sampling Data inspection • Feature counts Positional accuracy • Assessment tool • Attribute review • Version differences Arc. GIS Data Reviewer: An Introduction

Semi-automated review Leveraging Arc. GIS for Desktop Tools supporting - Selecting/browsing features Redlining missing features Flagging existing features in error Generating random samples Assessing positional accuracy Comparing geodatabase versions Arc. GIS Data Reviewer: An Introduction

Semi-automated review Leveraging Arc. GIS for Server • Extending quality control workflows into other communities - QC review across Arc. GIS platform - Simple to use tools for error identification - Manual QC workflow “automation” Arc. GIS Data Reviewer: An Introduction

Demo: Visual Data Review Arc. GIS Data Reviewer: An Introduction

Reporting Quality Arc. GIS Data Reviewer: An Introduction

Data Quality Reporting Arc. GIS for Desktop • Automated reporting of quality control results • Adhoc result summary tools • Pre-configured reports - Automated Check (Origin Table, Subtype, Check Group) - Total Record Count - Sampling Arc. GIS Data Reviewer: An Introduction

Data Quality Reporting Arc. GIS for Server Enabling transparency in data quality - Better decision making by communicating data quality across stakeholders - Open quality reporting - Shared across Arc. GIS system - Tools and methods to communicate quality Arc. GIS Data Reviewer: An Introduction

Demo Scenario • As a GIS manager, I need to manage the quality of the GIS database to ensure that it can support existing and new staff operations. • Business Requirements - Features should be positionally accurate based on siting criteria (95% accuracy) - Key attributes are populated and have the correct values (95% accuracy) Arc. GIS Data Reviewer: An Introduction

Demo: Reporting Quality Arc. GIS Data Reviewer: An Introduction

Managing Quality Results Arc. GIS Data Reviewer: An Introduction

Managing Quality Control QC lifecycle management REVIEW CORRECT VERIFY Find & Record Errors Perform Edits or Note Exceptions Acceptable or Unacceptable Arc. GIS Data Reviewer: An Introduction

Demo: Managing Quality Results Arc. GIS Data Reviewer: An Introduction

Workshop Review • Importance of data quality • Forms of data quality control • - Automated review - Semi-automated review Arc. GIS Data Reviewer - Automated validation - Semi-automated tools - Error lifecycle management - Reporting Arc. GIS Data Reviewer: An Introduction

Want to learn more? • Documentation - • • Resource Center Training - Assessing Data Quality using Arc. GIS Data Reviewer (Seminar) - Data QC with Arc. GIS: Automating Validation (Web Course) - Data QC with Arc. GIS: Visual Review (Web Course) - Quality Control Using Arc. GIS Data Reviewer for Desktop (Instructor Led) Questions/Comments - Geo. Net (Data Reviewer place) - Email (datareviewer@esri. com) Arc. GIS Data Reviewer: An Introduction