Arc GIS Data Reviewer Planning and Deploying Data

  • Slides: 48
Download presentation
Arc. GIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar

Arc. GIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar Chandrasekaran Esri UC 2014 | Technical Workshop |

A few examples of why data validation matters Esri UC 2014 | Technical Workshop

A few examples of why data validation matters Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Leaning Tower of Pisa Esri UC 2014 | Technical Workshop | Planning and Deploying

Leaning Tower of Pisa Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Mars Climate Orbiter (1999) Esri UC 2014 | Technical Workshop |

Mars Climate Orbiter (1999) Esri UC 2014 | Technical Workshop |

Garbage in Garbage Out (GIGO) Buildings Water Bodies Roads Esri UC 2014 | Technical

Garbage in Garbage Out (GIGO) Buildings Water Bodies Roads Esri UC 2014 | Technical Workshop | Type Presentation Title Here

Garbage in Quality Out Buildings Water Bodies Roads Esri UC 2014 | Technical Workshop

Garbage in Quality Out Buildings Water Bodies Roads Esri UC 2014 | Technical Workshop | Type Presentation Title Here

What is Arc. GIS Data Reviewer for Server? • System to support data quality

What is Arc. GIS Data Reviewer for Server? • System to support data quality management for Arc. GIS • Automates quality control process • Monitor and Measure data quality Validate Esri UC 2014 | Technical Workshop | Review Summarize

Enterprise Quality Management System Data Reviewer GIS Data Esri UC 2014 | Technical Workshop

Enterprise Quality Management System Data Reviewer GIS Data Esri UC 2014 | Technical Workshop | Type Presentation Title Here Server

Benefits of Data Reviewer for Server • Provides accurate data for your applications •

Benefits of Data Reviewer for Server • Provides accurate data for your applications • Measure and report data quality • Eliminate costs associated with poor data quality Esri UC 2014 | Technical Workshop |

Monitoring your data with validation Validate Esri UC 2014 | Technical Workshop | Planning

Monitoring your data with validation Validate Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Automated Validation Different Type of Issues in GIS Data Esri UC 2014 | Technical

Automated Validation Different Type of Issues in GIS Data Esri UC 2014 | Technical Workshop | Type Presentation Title Here

Automated Validation • Checks validate data based on conditions you define. • Results are

Automated Validation • Checks validate data based on conditions you define. • Results are written to the Reviewer workspace. Esri UC 2014 | Technical Workshop |

Automated Validation • Over 40 rules out of the box • Ability to extend

Automated Validation • Over 40 rules out of the box • Ability to extend validation with custom rules • Rules are authored using Arc. GIS Data Reviewer for Desktop Attribute/Table Esri UC 2014 | Technical Workshop | Feature integrity Spatial Relationships Item Metadata

Automated validation • Group checks into batch jobs Esri UC 2014 | Technical Workshop

Automated validation • Group checks into batch jobs Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Automated Validation Architecture Arc. GIS Server Reviewer Service Scheduler Execution Details Data Reviewer Web

Automated Validation Architecture Arc. GIS Server Reviewer Service Scheduler Execution Details Data Reviewer Web API REST API Validation Service Reviewer Workspace Esri UC 2014 | Technical Workshop | Type Presentation Title Here Data Workspace

Automated Review Demo Organization Contributor Esri UC 2014 | Technical Workshop | Planning and

Automated Review Demo Organization Contributor Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Analyzing Validation Results Esri UC 2014 | Technical Workshop | Planning and Deploying Data

Analyzing Validation Results Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Summarize data quality • Dashboard - Provides transparency to stakeholders on data quality -

Summarize data quality • Dashboard - Provides transparency to stakeholders on data quality - Ability for stakeholders to make informed and accurate decisions - Interactively summarize results based on different perspectives - Summaries are derived from results Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Summarize data quality Dashboard - Perspectives How many issues do I have by feature

Summarize data quality Dashboard - Perspectives How many issues do I have by feature class? How severe are the issues with my data? How many types of issues do I have in my data? How many issues have been reviewed and fixed? What are the issues on a geographic extent? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Dashboard Arc. GIS Server Reviewer Service Data Reviewer REST Web API Dashboard Reviewer Workspace

Dashboard Arc. GIS Server Reviewer Service Data Reviewer REST Web API Dashboard Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Results • Results are records that are stored in Reviewer workspace • Contains information

Results • Results are records that are stored in Reviewer workspace • Contains information about a feature or a row which failed QC standard • Query Results - Apply filters - Sort/Page Automate d Validation Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Results

Results • Spatial and non-spatial • Attributes describe check, problem, and validation information •

Results • Spatial and non-spatial • Attributes describe check, problem, and validation information • Object ID provides link back to feature that failed validation Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Results Arc. GIS Server Reviewer Service Data Reviewer REST Web API Results Reviewer Workspace

Results Arc. GIS Server Reviewer Service Data Reviewer REST Web API Results Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Analyze Results demo Contributor Esri UC 2014 | Technical Workshop | Planning and Deploying

Analyze Results demo Contributor Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Stewards

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Visual Quality Control Esri UC 2014 | Technical Workshop |

Visual Quality Control Esri UC 2014 | Technical Workshop |

Visual Review Process Reviewer Service Write Results Reviewer Geodatabase Arc. GIS Server Esri UC

Visual Review Process Reviewer Service Write Results Reviewer Geodatabase Arc. GIS Server Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Editor

Benefits of Visual Review • Get feedback from Subject Matter Experts (SME) • Identify

Benefits of Visual Review • Get feedback from Subject Matter Experts (SME) • Identify missing or incomplete data • Track issues reported Esri UC 2014 | Technical Workshop | Type Presentation Title Here

Visual Quality Control Demo Esri UC 2014 | Technical Workshop |

Visual Quality Control Demo Esri UC 2014 | Technical Workshop |

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality

Questions ? Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Deploying Data Quality Services Esri UC 2014 | Technical Workshop | Planning and Deploying

Deploying Data Quality Services Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Deploying Data Reviewer Services Single machine deployment Desktop Web Device Client Arc. GIS Server

Deploying Data Reviewer Services Single machine deployment Desktop Web Device Client Arc. GIS Server Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Server Data Workspace

Deploying Data Reviewer Services Single machine Deployment GP Service Validate Arc. GIS Server Single

Deploying Data Reviewer Services Single machine Deployment GP Service Validate Arc. GIS Server Single Machine GP Service Validate Inspect and Analyze Map Service Inspect and Analyze Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Map Service

Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Client Web Adaptor Reviewer Workspace

Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Client Web Adaptor Reviewer Workspace Servers Arc. GIS Servers Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace

Deploying Data Reviewer Services Multi-machine deployment Arc. GIS Servers Validate Inspect and Analyze Esri

Deploying Data Reviewer Services Multi-machine deployment Arc. GIS Servers Validate Inspect and Analyze Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services GP Service Map Service

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Client Amazon Elastic

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Client Amazon Elastic Cloud Reviewer Workspace Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Validate AGS - Amazon EC Inspect

Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Validate AGS - Amazon EC Inspect and Analyze Validate AGS - Amazon EC Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Inspect and Analyze GP Service Map Service

Data Reviewer Server Out of the Box • • Execute Batch. Job GP Service

Data Reviewer Server Out of the Box • • Execute Batch. Job GP Service Server components - Execute Batch Job GP Service - Reviewer Service - REST API Web components - Client API Reference (Java. Script & Flex) - Starter Applications (Batch Validation Manager) - Widgets (Flex & Java. Script) Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Reviewer Service

Data Reviewer Platform • Arc. GIS Data Reviewer for Desktop Define and author Quality

Data Reviewer Platform • Arc. GIS Data Reviewer for Desktop Define and author Quality Control Standards - Configure Reviewer Workspace to store results - • Arc. GIS Data Reviewer for Server Schedule and run automated validations - Analyze result stored in Reviewer workspace - Submit SME feedback for Reviewer workspace for visual review - • Client API’s - Develop applications to access data quality services Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Widgets and Starter Apps - Demo Esri UC 2014 | Technical Workshop | Planning

Widgets and Starter Apps - Demo Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Arc. GIS Data Reviewer Server System Architecture Batch Validation Service Dashboard HTTP/REST Results Reviewer

Arc. GIS Data Reviewer Server System Architecture Batch Validation Service Dashboard HTTP/REST Results Reviewer Workspace Visual Review Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services Data Workspace

Resources • Product page - • Resource Center - • http: //resources. arcgis. com/en/communities/data-reviewer/

Resources • Product page - • Resource Center - • http: //resources. arcgis. com/en/communities/data-reviewer/ Training - • www. esri. com/datareviewer www. esri. com/training Questions & comments - datareviewer@esri. com Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Resource Center – Data Reviewer • Gallery - Apps - Templates - Tutorials •

Resource Center – Data Reviewer • Gallery - Apps - Templates - Tutorials • API Documentation • Live Samples Esri UC 2014 | Technical Workshop |

Day and Description Type Time Location Tuesday July 15 Arc. GIS Data Reviewer: An

Day and Description Type Time Location Tuesday July 15 Arc. GIS Data Reviewer: An Introduction Technical Workshop 8: 30 – 9: 45 am Room 14 A Arc. GIS Data Reviewer: Extending the Validation Framework Demo Theater 9: 30 – 10: 00 am Geodata Mgmt Theater Arc. GIS Data Reviewer: Leveraging Geoprocessing for Data Demo Theater 10: 30 – 11: 00 am Geodata Mgmt Theater Arc. GIS Data Reviewer: Assessing Positional Accuracy Demo Theater 1: 00 – 1: 30 pm Geodata Mgmt Theater Arc. GIS Data Reviewer: Plans for Quality Assessment of Raster Datasets Demo Theater 5: 30 – 6: 00 pm Geodata Mgmt Theater Technical Workshop 8: 30 – 9: 45 am Room 14 A Demo Theater 11: 30 – 12: 00 am Geodata Mgmt Theater SIG 12: 00 – 1: 00 pm Room 15 B Technical Workshop 3: 15 – 4: 30 pm Room 15 B Validation Wednesday July 16 Arc. GIS Data Reviewer: An Introduction Arc. GIS Data Reviewer: Integrating Arc. GIS Data Reviewer and Arc. GIS Workflow Manager to Automate Data Quality Control Workflows Arc. GIS Data Reviewer: Special Interest Group Meeting Arc. GIS Data Reviewer: Planning and Deploying Data Quality Services Thursday July 17 Arc. GIS Data Reviewer: Integrating Data Validation Capabilities Into Web Applications Demo Theater 9: 30 – 10: 00 am Web & Server Theater Arc. GIS Data Reviewer: Implementing Data Quality Reporting in Web Clients Demo Theater 10: 30 – 11: 00 am Web & Server Theater

Questions ? Planning and Deploying Data Quality Services

Questions ? Planning and Deploying Data Quality Services

Thank you… • Please fill out the session survey: Offering ID: 1313 Online –

Thank you… • Please fill out the session survey: Offering ID: 1313 Online – www. esri. com/ucsessionsurveys Paper – pick up and put in drop box Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services

Esri UC 2014 | Technical Workshop | Planning and Deploying Data Quality Services