Arc GIS Data Reviewer Planning and Deploying Data
















































- Slides: 48
Arc. GIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar Chandrasekaran Esri UC 2014 | Technical Workshop |
A few examples of why data validation matters Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Leaning Tower of Pisa Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Mars Climate Orbiter (1999) Esri UC 2014 | Technical Workshop |
Garbage in Garbage Out (GIGO) Buildings Water Bodies Roads Esri UC 2014 | Technical Workshop | Type Presentation Title Here
Garbage in Quality Out Buildings Water Bodies Roads Esri UC 2014 | Technical Workshop | Type Presentation Title Here
What is Arc. GIS Data Reviewer for Server? • System to support data quality management for Arc. GIS • Automates quality control process • Monitor and Measure data quality Validate Esri UC 2014 | Technical Workshop | Review Summarize
Enterprise Quality Management System Data Reviewer GIS Data Esri UC 2014 | Technical Workshop | Type Presentation Title Here Server
Benefits of Data Reviewer for Server • Provides accurate data for your applications • Measure and report data quality • Eliminate costs associated with poor data quality Esri UC 2014 | Technical Workshop |
Monitoring your data with validation Validate Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Automated Validation Different Type of Issues in GIS Data Esri UC 2014 | Technical Workshop | Type Presentation Title Here
Automated Validation • Checks validate data based on conditions you define. • Results are written to the Reviewer workspace. Esri UC 2014 | Technical Workshop |
Automated Validation • Over 40 rules out of the box • Ability to extend validation with custom rules • Rules are authored using Arc. GIS Data Reviewer for Desktop Attribute/Table Esri UC 2014 | Technical Workshop | Feature integrity Spatial Relationships Item Metadata
Automated validation • Group checks into batch jobs Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Automated Validation Architecture Arc. GIS Server Reviewer Service Scheduler Execution Details Data Reviewer Web API REST API Validation Service Reviewer Workspace Esri UC 2014 | Technical Workshop | Type Presentation Title Here Data Workspace
Automated Review Demo Organization Contributor Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Analyzing Validation Results Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Summarize data quality • Dashboard - Provides transparency to stakeholders on data quality - Ability for stakeholders to make informed and accurate decisions - Interactively summarize results based on different perspectives - Summaries are derived from results Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Summarize data quality Dashboard - Perspectives How many issues do I have by feature class? How severe are the issues with my data? How many types of issues do I have in my data? How many issues have been reviewed and fixed? What are the issues on a geographic extent? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Dashboard Arc. GIS Server Reviewer Service Data Reviewer REST Web API Dashboard Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Results • Results are records that are stored in Reviewer workspace • Contains information about a feature or a row which failed QC standard • Query Results - Apply filters - Sort/Page Automate d Validation Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Results
Results • Spatial and non-spatial • Attributes describe check, problem, and validation information • Object ID provides link back to feature that failed validation Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Results Arc. GIS Server Reviewer Service Data Reviewer REST Web API Results Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Analyze Results demo Contributor Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Stewards
Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Visual Quality Control Esri UC 2014 | Technical Workshop |
Visual Review Process Reviewer Service Write Results Reviewer Geodatabase Arc. GIS Server Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Editor
Benefits of Visual Review • Get feedback from Subject Matter Experts (SME) • Identify missing or incomplete data • Track issues reported Esri UC 2014 | Technical Workshop | Type Presentation Title Here
Visual Quality Control Demo Esri UC 2014 | Technical Workshop |
Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Deploying Data Quality Services Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Single machine deployment Desktop Web Device Client Arc. GIS Server Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Server Data Workspace
Deploying Data Reviewer Services Single machine Deployment GP Service Validate Arc. GIS Server Single Machine GP Service Validate Inspect and Analyze Map Service Inspect and Analyze Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Map Service
Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Client Web Adaptor Reviewer Workspace Servers Arc. GIS Servers Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace
Deploying Data Reviewer Services Multi-machine deployment Arc. GIS Servers Validate Inspect and Analyze Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services GP Service Map Service
Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Client Amazon Elastic Cloud Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace
Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Validate AGS - Amazon EC Inspect and Analyze Validate AGS - Amazon EC Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Inspect and Analyze GP Service Map Service
Data Reviewer Server Out of the Box • • Execute Batch. Job GP Service Server components - Execute Batch Job GP Service - Reviewer Service - REST API Web components - Client API Reference (Java. Script & Flex) - Starter Applications (Batch Validation Manager) - Widgets (Flex & Java. Script) Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Reviewer Service
Data Reviewer Platform • Arc. GIS Data Reviewer for Desktop Define and author Quality Control Standards - Configure Reviewer Workspace to store results - • Arc. GIS Data Reviewer for Server Schedule and run automated validations - Analyze result stored in Reviewer workspace - Submit SME feedback for Reviewer workspace for visual review - • Client API’s - Develop applications to access data quality services Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Widgets and Starter Apps - Demo Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Arc. GIS Data Reviewer Server System Architecture Batch Validation Service Dashboard HTTP/REST Results Reviewer Workspace Visual Review Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace
Resources • Product page - • Resource Center - • http: //resources. arcgis. com/en/communities/data-reviewer/ Training - • www. esri. com/datareviewer www. esri. com/training Questions & comments - datareviewer@esri. com Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Resource Center – Data Reviewer • Gallery - Apps - Templates - Tutorials • API Documentation • Live Samples Esri UC 2014 | Technical Workshop |
Day and Description Type Time Location Tuesday July 15 Arc. GIS Data Reviewer: An Introduction Technical Workshop 8: 30 – 9: 45 am Room 14 A Arc. GIS Data Reviewer: Extending the Validation Framework Demo Theater 9: 30 – 10: 00 am Geodata Mgmt Theater Arc. GIS Data Reviewer: Leveraging Geoprocessing for Data Demo Theater 10: 30 – 11: 00 am Geodata Mgmt Theater Arc. GIS Data Reviewer: Assessing Positional Accuracy Demo Theater 1: 00 – 1: 30 pm Geodata Mgmt Theater Arc. GIS Data Reviewer: Plans for Quality Assessment of Raster Datasets Demo Theater 5: 30 – 6: 00 pm Geodata Mgmt Theater Technical Workshop 8: 30 – 9: 45 am Room 14 A Demo Theater 11: 30 – 12: 00 am Geodata Mgmt Theater SIG 12: 00 – 1: 00 pm Room 15 B Technical Workshop 3: 15 – 4: 30 pm Room 15 B Validation Wednesday July 16 Arc. GIS Data Reviewer: An Introduction Arc. GIS Data Reviewer: Integrating Arc. GIS Data Reviewer and Arc. GIS Workflow Manager to Automate Data Quality Control Workflows Arc. GIS Data Reviewer: Special Interest Group Meeting Arc. GIS Data Reviewer: Planning and Deploying Data Quality Services Thursday July 17 Arc. GIS Data Reviewer: Integrating Data Validation Capabilities Into Web Applications Demo Theater 9: 30 – 10: 00 am Web & Server Theater Arc. GIS Data Reviewer: Implementing Data Quality Reporting in Web Clients Demo Theater 10: 30 – 11: 00 am Web & Server Theater
Questions ? Planning and Deploying Data Quality Services
Thank you… • Please fill out the session survey: Offering ID: 1313 Online – www. esri. com/ucsessionsurveys Paper – pick up and put in drop box Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services
Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services