ArcGIS Data Reviewer Advanced Data Validation Concepts. Francisco Perez & Shankar Chandrasekaran

Transcription

1 ArcGIS Data Reviewer Advanced Data Validation Concepts Francisco Perez & Shankar Chandrasekaran

2 rkshop Agenda Importance of Data Quality What is ArcGIS Data Reviewer? Automated Validation Extending Automated Validation Semi-Automated Review Analyzing & Reporting Data Quality References/Resources

3 y Quality Control Matters In 1976 the Teton dam collapsed due to improper materials used in construction. In 2009 Toyota Recalled 9 Million cars due to faulty floor mat. In 2010 BP Deepwater Horizon Rig exploded due to a number of quality failures. In 2015 Refugio State Beach Oil Spill -The pipeline did not have an automatic shut-off valve that would have been required on an intrastate pipeline

4 rbage in Garbage Out Buildings Water Bodies Roads

5 rbage in Quality Out Buildings Water Bodies Roads

6 at is ArcGIS Data Reviewer? ta Quality Management for ArcGIS System to support data quality management for ArcGIS Automates quality control process Monitor and Measure data quality Validate Review Summarize

7 Data Revie at is ArcGIS Data Reviewer? atform data quality challenges GIS Data Server

8 at is ArcGIS Data Reviewer? nefits of Data Reviewer Provides accurate data for your applications Measure and report data quality Eliminate costs associated with poor data quality

9 Automated Validation

10 tomated Data Quality Rules ementing business rules with Reviewer Checks Reviewer Batch Jobs - Define and encapsulate quality requirements - Captures domain knowledge - Designed once and executed many times - ArcGIS for Desktop, ArcGIS for Server

11 tomated Validation Categories fferent Type of Issues in GIS Data Attribution Feature Integrity Metadata Spatial Relationships

12 tomated Validation Business Scenario- Validate Data Submission ta Reviewer date mobile data from data contributors

13 m Requirements to Data Reviewer Automated Checks ta Quality Management for ArcGIS Business Needs Contributor Portal Automated Checks Extended Semi-Auto QA Functional Requirements Requirements Automated Checks

14 quirements ta Reviewer Automated Checks es: Add information about the corresponding Site Address Points Ensure that the driveway and building entrance points overlap the corresponding parcel feature For driveway entrance points the location must be in the driveway

15 ending Automated Validation ta Reviewer Automated Checks date Existing Data: ck the accuracy of existing Site address ts and identify whether they have been rrectly attributed

16 tomated Review Demo rganization Contributor Portal Contributors Requirements Batch Job Results

17 uestions?

18 Semi-Automated Review

19 ual Quality Control Process Reviewer Service Write Results Organization SMEs Reviewer Editor Users Geodatabase ArcGIS Server

20 i-automated review methods Positional Accuracy Data Inspection tools Visual Review Identifying missing or misplaced features Random Sampling

21 mi-automated review methods Positional Accuracy Data Inspection Tools Report Features Draw Geometries on the map

22 ue of performing visual review Discover Patterns Visual Review Finding Missing Features Compare to Trusted Sources

23 nefits of Visual Quality Control Get feedback from Subject Matter Experts (SME) Find issues not detectable by automated validation Track issues reported

24 Visual Review Demo

25 siness Scenario Visual Review Quality Management for ArcGIS Visual Quality Control On-Site Field Crew QC Editors

26 estions?

27 Report & Analyze Data Quality

28 data quality transparency to stakeholders on data quality stakeholders to make informed and accurate decisions ely summarize results based on different perspectives s are derived from results

29 ata quality What are the issues on a geographic extent? How severe are the issues with my data? How many types of issues do I have in my data? How many issues do I have by feature class? How many issues have been reviewed and fixed?

30 sults d non-spatial describe check, problem, and validation information provides link back to feature that failed validation

31 sults records that are stored in Reviewer workspace formation about a feature or a row which failed QC standard lts s tomated lidation Results

32 alyze Architecture ArcGIS Server Reviewer Map Service Data Reviewer Web API REST API Results Dashboard Reviewer Workspace

33 Analyze - Demo tion Contributor

34 estions?

35 management - ArcGIS platform a Quality with ewer for Desktop Desktop Web Device Pro ith ewer for Server ArcGIS Online Portal m Apps with ewer JavaScript API ard Apps with Server Online Content and Services

36 rt ates wer templates utilities ernment ources ities sri industry models ting point

37 rn more this week? June 28 ata Reviewer: Day and Description Type Time Location An Introduction Technical Workshop ata Reviewer: Assessing Positional Accuracy Demo Theater 10:30 11:15am ata Reviewer: Integrating ArcGIS Data Reviewer and ArcGIS Workflow Manager to Automate Data Quality Control Workflows ata Reviewer: Leveraging Geoprocessing for Data Validation ata Reviewer: Quality Assessment for Elevation Raster Datasets ay June 29 ata Reviewer: June 30 ata Reviewer: ata Reviewer: ata Reviewer: An Introduction Advanced Data Validation Concepts Implementing Data Quality Reporting in Web Clients Integrating Data Validation Capabilities into Web Applications Demo Theater Demo Theater Demo Theater Technical Workshop Technical Workshop Demo Theater Demo Theater 8:30 9:45am Room 15B 11:30 12:15pm 12:30 1:15pm 2:30 3:15pm 3:15 4:30pm Demo Theater 4 Geodata Demo Theater 4 Geodata Demo Theater 4 Geodata Demo Theater 4 Geodata Sapphire Ballroom A/B 8:30 9:45am Room 32 A/B 10:30 11:15am 12:30 1:15pm Demo Theater 6 Server Demo Theater 6 Server

38 n more? ormation /datareviewer

39 n more? tion rver.arcgis.com)

40 n more? tion aining.esri.com) g Data Quality using ArcGIS Data Reviewer (Seminar) g Positional Accuracy Using ArcGIS Data Reviewer for Desktop (Seminar) ith ArcGIS: Automating Validation (Web Course) ith ArcGIS: Visual Review (Web Course) ontrol Using ArcGIS Data Reviewer for Desktop (Instructor-Led)

41 n more? tion g Data Quality using ArcGIS Data Reviewer (Seminar) g Positional Accuracy Using ArcGIS Data Reviewer for Desktop (Seminar) ith ArcGIS: Automating Validation (Web Course) ith ArcGIS: Visual Review (Web Course) ontrol Using ArcGIS Data Reviewer for Desktop (Instructor Led) onet.esri.com) ewer place

42 ! ut the session survey using the Esri Events vance Data Validation Concepts session earch Feature to quickly find this title n to the Feedback section ew short questions, enter any comments and mit!

43