Road Ahead: Linear Referencing and UPDM Esri European Petroleum GIS Conference November 7, 2014 Congress Centre, London
Your Work Making a Difference
ArcGIS Is Evolving Your GIS Is Becoming Part of an Interconnected Platform Apps Desktop Server Content, Management & Hosting Bringing Together Data, Technology, and People...... Creating a Framework for Solving Complex Problems
The ArcGIS Platform for the Pipeline Industries Platform Real-Time Location Referencing Data Model Network Management
The ArcGIS Platform for the Pipeline Industries Platform Real-Time Location Referencing Data Model Network Management Pipeline data management Linear referencing Coordinate referencing
The ArcGIS Platform for the Pipeline Industries Platform Real-Time Location Referencing Data Model Network Management Wellhead to customer meter or delivery point Each pipeline component is a single database table object
The ArcGIS Platform for the Pipeline Industries Platform Real-Time Location Referencing Data Model Network Management Performance Improved information model New productivity tools Accessible across the platform
ArcGIS Location Referencing for Pipelines
ArcGIS Location Referencing for Pipelines Linear Referencing for the Pipeline Enterprise GIS-enabled LRS platform LRS management LRS editing & maintenance LRS web services Information model Workflow Quality control GIS analysis Mapping Cloud collaboration
ArcGIS Location Referencing for Pipelines Linear Referencing for the Pipeline Enterprise Web Event Editing GIS-enabled LRS platform
ArcGIS Location Referencing for Pipelines Linear Referencing for the Pipeline Enterprise Web Event Editing Measure and Location Reporting GIS-enabled LRS platform
ArcGIS Location Referencing for Pipelines Linear Referencing for the Pipeline Enterprise HCA Analysis Risk Assessment and Modeling Web Event Editing Measure and Location Reporting Transmission Distribution Simulation and Optimization ILI Analysis Partner Solutions & Services Alignment Sheets Generators Consulting & Data Migration Engineering Pipeline Design Maintenance Management and Planning and more GIS-enabled LRS platform
Product Overview Desktop - ArcGIS Pro LRS network editing ribbon - Route & event feature class support - Geodatabase LRS dataset - Geoprocessing tools Comes with Production Mapping Data Reviewer Workflow Manager Server - LRS web services - Developer samples - Pipeline Characteristics Editor
ArcGIS Pro Application Extension Why ArcGIS Pro? Next generation GIS desktop Higher LRS platform for migration 64 bit & multi-threaded Integrated 3D Multiple linked map views Context based experience Tasks for guided editing
Highlighted Functionality Current Future 1 Multi-LRM Support & Schema X 2 Editing X X 3 Rule-Based Location Management X 4 Stationing X (required) 5 Expanded Pipeline-Specific Linear Referencing X (opt.) X
Multi-LRM Support Route features are generated from centerline geometry and calibration point measures LRS Network A 0 15 30 Two routes LRS Network B -5 30 45 3 Calibration points Centerline 3 centerlines The two routes above are derived from three centerline lines
Location Model Schema for route centerline management Routes Route definitions. 1 1 Calibration points Centerline sequence M M Point feature class that stores route measures. Key table for M-N relationship between Centerline and Route. N Centerline 1 Line feature class that stores route geometry. Route features are generated from two feature classes and two tables
Highlighted Functionality Current Future 1 Multi-LRM Support & Schema X 2 Editing X X 3 Rule-Based Location Management X 4 Stationing X (required) 5 Expanded Pipeline-Specific Linear Referencing X (opt.) X
Route Editing Activities Create Route 0 100 120 Extend Route 0 100 Realign Route 0 20 80 retired 100 Can also serve to split routes and merge routes. Reassign Route 0 20 80 100 I-10 I-110 I-10 Retire Route 0 20 80 100 retired 1-10 Calibration 0 52 100
Network editing ribbon bar choose centerlines to associate to routes apply measure updates to events impacted by route edits ribbon tab only displays when location referencing data in map edit routes and route measures edit centerlines that make up routes identify measures and search for routes
Customizable layout By default, location referencing activity dialogs will display in the right hand pane. Location of pane can be customized in ArcGIS Pro
Highlighted Functionality Current Future 1 Multi-LRM Support & Schema X 2 Editing & Redlining X X 3 Rule-Based Location Management X 4 Stationing X (required) 5 Expanded Pipeline-Specific Linear Referencing X (opt.) X
Event Measure Behaviors Before Realignment Stay Put When the LRS routes are edited, measure behavior rules can be applied to events. Move Events can have a different behavior for each type of LRS edit Retire
Highlighted Functionality Current Future 1 Multi-LRM Support & Schema X 2 Editing & Redlining X X 3 Rule-Based Location Management X 4 Stationing X (required) 5 Expanded Pipeline-Specific Linear Referencing X (opt.) X
Pipeline Stationing - Example Stationing is an address along the pipeline. Here is a pipeline that is 20,000 ft. in length with stations shown each 5,000 ft. 00+00 50+00 100+00 150+00 200+00
Pipeline Stationing - Example Here s the same pipeline after a reroute that added a new section of pipe 2,000 ft. longer than the original section of pipe that was abandoned or reclaimed. Station equations are used to equate stationing between two adjacent surveys. The upstream tie-in for the reroute is at 50+00. The downstream tie-in for the reroute is 170+00 (back) and 150+00 (ahead). Station Equation Back 170+00 100+00 150+00 Ahead 150+00 170+00 00+00 50+00 100+00 150+00 200+00 Credit: New Century Software / PODS 101 Workshop
Stationing Manage station equations as events - Coordinate locations, with route and measure - Edit from Pipeline Characteristic Editor - Support stationing without a stationing network 3 ways to input station measures - Offsetting on stationing event layer - Providing temporary starting station location - Selecting starting station to offset from if station location ambiguous due to equations, user prompted for which map location is desired.
Engineering Stationing is Supported, but is not Required.
Highlighted Functionality Current Future 1 Multi-LRM Support & Schema X 2 Editing & Redlining X X 3 Rule-Based Location Management X 4 Stationing X (required) 5 Expanded Pipeline-Specific Linear Referencing X (opt.) X
Linear events spanning routes Continuous Station Series A 350 650 1000 0 300 450 Gas HCA Segment 300 500 0 350 300 600 700 1050 Engineering Station Series 1000 2000 3000 Credit: Eagle Information Mapping
Base event location model Events columns - Event ID - From Route ID - From Measure - To Route ID (if event spans routes) - To Measure (if linear event) - From Date - To Date - Location Error
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Flexibility in event location referencing Route and measure Stationing Referent and offset - Intersections - Events - Features Calibration Point: 1 mile Station Event: 100+00.00 Intersection Features US Highway 10 crossing Event: 1.27 miles Event: 456+25.00 Event: 300 feet from US Highway 10 Coordinates and offset Event: 45 feet from cell tower with intersection creation support Cell tower location: 34.0547,117.1825
Referent event location model EventID RouteID Measure Type Ref_Method Ref_Location Ref_Offset 1 I94 0.789 Valve 04 - Intersection {ACE45-51112-54523} 1000 2 I94 0.4 Pump 06 - Milepoint I94 0.4 3 I94 1.4 Station 01 - XY -77.067290,39.946920 0 4 I94 1.211 Meter 03 - Stationing {44553-99883-55443} 110+00 Events columns - Referent method - Referent location - Referent offset Linear events maintain From and To reference columns
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Temporality Date ranges can be applied to LRS edits Event measure updates reflect date ranges of LRS edits Historical event measures that change due to LRS edits are retired View After Temporal View Date enables data visualization and query for any moment in time Integrated with ArcGIS notion of time View Before
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Geoprocessing Tools Convert M-value Unit of Measure Detect Measures Out Of Range Detect Overlaps For Linear Events Detect Gaps For Linear Events Detect Measures Non-monotonic Routes Generate Routes Generate Calibration Points Translate Events From LRM to LRM Update Calibration Points Update Intersections and growing.
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Measure based reporting for decision makers Web based for PC or tablet - Opens data to decision makers Combine and filter multiple event layers Produces - Tabular reports, maps, data products Report types - Length summary reports - Route locations, segments, log
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Linear Referencing capability for ArcGIS Server ArcGIS for Server - Mapping, Query, Geoprocessing Location Referencing for Server - Event editing - Coordinate to measures (includes stationing) - Measure to coordinate (includes stationing) - Query attribute sets - Check events (gaps, overlaps, invalid measures) - Measure translation - Measure updates for external systems - Measure based reporting LRS Web Services Location Referencing Server Desktop Web Connected Mobile
Highlighted Functionality Current Future 6 Flexibility in Event Location Referencing X 7 Temporality X 8 Geoprocessing Tools X X 9 Measure-Based Reporting for Decision- Makers X 10 Linear Referencing Web Services X 11 Pipeline Characteristics Editor X
Pipeline Characteristics Editor Web based event editing Delivers with the Server Built entirely on web services JavaScript / HTML 5 app
Web based event editing and QC Editing - Line event attribute sets - Points events - Selection results - Attribute set results Selection QC - Select by route, attribute, geometry, proximity - Single layer results or attribute sets - Gaps, overlaps, invalid measures - Data Reviewer batch checks
Dynamic segmentation Operating Pressure Pressure Test 800 1000 1000 1500 1200 Coating Type Coal Tar FBE Coal Tar FBE Coal Tar Resultant Segmentation 0 10 16 24 33 35 41 10 20 30 40 50 Credit: DNV GL Software
Data Model Support Toolset flexibility Adoption of a full Data Model not required Event model flexible Web services to get network changes Routes Location model is required Centerline sequence M 1 1 M Calibration points N 1 Centerline Type Presentation Title Here
Data Models Supported Keeping Pace with ArcGIS Platform and Location Referencing Advances Route editing UPDM APDM PODS Esri Spatial X Event editing X X X PODS Relational LRS network sync (1 way) N/A X X X Event measure updates N/A X X X Keep other data models events and networks in sync, for systems that can t migrate right away or never will
Scope and schedule BETA Q1 2015 - ArcGIS Pro LRS network editing tools - Location Referencing Server - Web Event Editing - Web Reporting ArcGIS Pro Releases SDK in BETA 10.3 Location Referencing for Pipeline 2015 BETA Release 1.0 TBD - ArcGIS Pro LRS management & configuration - Geoprocessing tools 2014
UPDM Utility & Pipeline Data Model
Business Drivers for UPDM Enable combination utilities that have both distribution and transmission to use one data model Simplify staff training Single workflow for maintaining distribution and transmission asset data Better manage HP Distribution pipe (> 20% SMYS) Improve staff efficiency and productivity
Technical Drivers to Evolve UPDM Represent Best practice for managing data in a Geodatabase Align with ArcGIS Pro and advances being developed in the ArcGIS Pro environment Align with ArcGIS Location Referencing for Pipelines Improve scalability and performance for larger pipe systems
About UPDM Esri s UPDM is a geodatabase data model template for operators of pipe networks in the gas and hazardous liquids industries. UPDM is a moderately normalized data model that explicitly represents each physical component of a pipe network from the wellhead to the customer meter, terminal or delivery point, in a single database table object.
UPDM history Traces its heritage to the first release of the Gas Data Model in 2001, being renamed now to reflect broadened scope Partners and customers always have played a role in the development of the Gas Data Model, and we look forward to continuing that collaboration with UPDM Esri has actively maintained and enhanced the Gas Data Model through the years, and that will continue with UPDM
Geodatabase Concepts & UPDM All events stored as features Connectivity model used to maintain physical assets Linear referencing model used to maintain transmission integrity data Metadata managed as part of feature (Editor Tracking & Archiving) Documents managed with Attachments Time Aware (be able to view system at different states in time)
Improving Performance thru Better Data Management Transmission Viewing Pipe Segments Database Activity with Legacy Data Model 1 Geodatabase 3 Tables/Featureclasses queried Database Activity with UPDM 1 Geodatabase 1 Featureclass queried 66% Reduction in SQL queries in the database
Improving Performance thru Better Data Management Transmission & Distribution Viewing Pipe Segments Database Activity with Legacy Data Model 2 Geodatabases 4 Tables/Featureclasses queried Database Activity with UPDM 1 Geodatabase 1 Featureclass queried 75% Reduction in SQL queries in the database
Improving Scalability thru Data Storage Efficiency Transmission Legacy Data Models UPDM PipeSegment Pipes PipeSegmentAudit Valve Valves ValveAudit 50% Reduction in Records stored in the database
Improving Scalability thru Data Storage Efficiency Transmission & Distribution Legacy Data Models UPDM PipeSegment PipeSegmentAudit Pipes Mains 33% Reduction in Records stored in the database 66% Reduction in tables stored in the database
Release Sequence Configured for Geometric Network Configured for Facility Network ALRP Schema UPDM for 10.2 Yes No UPDM for 10.3 (concurrent with ALRP Beta release) UPDM release after 10.3 Yes Yes Yes Yes
Thank you, it s question time! Contact me at tcoolidge@esri.com