ArcGIS Data Reviewer Advanced Data Validation Concepts Francisco Perez & Shankar Chandrasekaran
rkshop Agenda Importance of Data Quality What is ArcGIS Data Reviewer? Automated Validation Extending Automated Validation Semi-Automated Review Analyzing & Reporting Data Quality References/Resources
y Quality Control Matters In 1976 the Teton dam collapsed due to improper materials used in construction. In 2009 Toyota Recalled 9 Million cars due to faulty floor mat. In 2010 BP Deepwater Horizon Rig exploded due to a number of quality failures. In 2015 Refugio State Beach Oil Spill -The pipeline did not have an automatic shut-off valve that would have been required on an intrastate pipeline
rbage in Garbage Out Buildings Water Bodies Roads
rbage in Quality Out Buildings Water Bodies Roads
at is ArcGIS Data Reviewer? ta Quality Management for ArcGIS System to support data quality management for ArcGIS Automates quality control process Monitor and Measure data quality Validate Review Summarize
Data Revie at is ArcGIS Data Reviewer? atform data quality challenges GIS Data Server
at is ArcGIS Data Reviewer? nefits of Data Reviewer Provides accurate data for your applications Measure and report data quality Eliminate costs associated with poor data quality
Automated Validation
tomated Data Quality Rules ementing business rules with Reviewer Checks Reviewer Batch Jobs - Define and encapsulate quality requirements - Captures domain knowledge - Designed once and executed many times - ArcGIS for Desktop, ArcGIS for Server
tomated Validation Categories fferent Type of Issues in GIS Data Attribution Feature Integrity Metadata Spatial Relationships
tomated Validation Business Scenario- Validate Data Submission ta Reviewer date mobile data from data contributors
m Requirements to Data Reviewer Automated Checks ta Quality Management for ArcGIS Business Needs Contributor Portal Automated Checks Extended Semi-Auto QA Functional Requirements Requirements Automated Checks
quirements ta Reviewer Automated Checks es: Add information about the corresponding Site Address Points Ensure that the driveway and building entrance points overlap the corresponding parcel feature For driveway entrance points the location must be in the driveway
ending Automated Validation ta Reviewer Automated Checks date Existing Data: ck the accuracy of existing Site address ts and identify whether they have been rrectly attributed
tomated Review Demo rganization Contributor Portal Contributors Requirements Batch Job Results
uestions?
Semi-Automated Review
ual Quality Control Process Reviewer Service Write Results Organization SMEs Reviewer Editor Users Geodatabase ArcGIS Server
i-automated review methods Positional Accuracy Data Inspection tools Visual Review Identifying missing or misplaced features Random Sampling
mi-automated review methods Positional Accuracy Data Inspection Tools Report Features Draw Geometries on the map
ue of performing visual review Discover Patterns Visual Review Finding Missing Features Compare to Trusted Sources
nefits of Visual Quality Control Get feedback from Subject Matter Experts (SME) Find issues not detectable by automated validation Track issues reported
Visual Review Demo
siness Scenario Visual Review Quality Management for ArcGIS Visual Quality Control On-Site Field Crew QC Editors
estions?
Report & Analyze Data Quality
data quality transparency to stakeholders on data quality stakeholders to make informed and accurate decisions ely summarize results based on different perspectives s are derived from results
ata quality What are the issues on a geographic extent? How severe are the issues with my data? How many types of issues do I have in my data? How many issues do I have by feature class? How many issues have been reviewed and fixed?
sults d non-spatial describe check, problem, and validation information provides link back to feature that failed validation
sults records that are stored in Reviewer workspace formation about a feature or a row which failed QC standard lts s tomated lidation Results
alyze Architecture ArcGIS Server Reviewer Map Service Data Reviewer Web API REST API Results Dashboard Reviewer Workspace
Analyze - Demo tion Contributor
estions?
management - ArcGIS platform a Quality with ewer for Desktop Desktop Web Device Pro ith ewer for Server ArcGIS Online Portal m Apps with ewer JavaScript API ard Apps with Server Online Content and Services
rt ates wer templates utilities ernment ources ities sri industry models ting point
rn more this week? June 28 ata Reviewer: Day and Description Type Time Location An Introduction Technical Workshop ata Reviewer: Assessing Positional Accuracy Demo Theater 10:30 11:15am ata Reviewer: Integrating ArcGIS Data Reviewer and ArcGIS Workflow Manager to Automate Data Quality Control Workflows ata Reviewer: Leveraging Geoprocessing for Data Validation ata Reviewer: Quality Assessment for Elevation Raster Datasets ay June 29 ata Reviewer: June 30 ata Reviewer: ata Reviewer: ata Reviewer: An Introduction Advanced Data Validation Concepts Implementing Data Quality Reporting in Web Clients Integrating Data Validation Capabilities into Web Applications Demo Theater Demo Theater Demo Theater Technical Workshop Technical Workshop Demo Theater Demo Theater 8:30 9:45am Room 15B 11:30 12:15pm 12:30 1:15pm 2:30 3:15pm 3:15 4:30pm Demo Theater 4 Geodata Demo Theater 4 Geodata Demo Theater 4 Geodata Demo Theater 4 Geodata Sapphire Ballroom A/B 8:30 9:45am Room 32 A/B 10:30 11:15am 12:30 1:15pm Demo Theater 6 Server Demo Theater 6 Server
n more? ormation /datareviewer
n more? tion rver.arcgis.com)
n more? tion aining.esri.com) g Data Quality using ArcGIS Data Reviewer (Seminar) g Positional Accuracy Using ArcGIS Data Reviewer for Desktop (Seminar) ith ArcGIS: Automating Validation (Web Course) ith ArcGIS: Visual Review (Web Course) ontrol Using ArcGIS Data Reviewer for Desktop (Instructor-Led)
n more? tion g Data Quality using ArcGIS Data Reviewer (Seminar) g Positional Accuracy Using ArcGIS Data Reviewer for Desktop (Seminar) ith ArcGIS: Automating Validation (Web Course) ith ArcGIS: Visual Review (Web Course) ontrol Using ArcGIS Data Reviewer for Desktop (Instructor Led) onet.esri.com) ewer place
! ut the session survey using the Esri Events vance Data Validation Concepts session earch Feature to quickly find this title n to the Feedback section ew short questions, enter any comments and mit!