GIS Capability Maturity Assessment: How is Your Organization Doing? Presented by: Bill Johnstone Principal Consultant Spatial Vision Group November 8, 2018
1. Motivation for Capability Maturity Models GIS User Organizations - Past: - Early GIS implementations: - Should we use GIS? - What can it do for us? - How much will it cost? - How long will it take? - What are the benefits? GIS User Organizations - Today: - Enterprise GIS: - How well are we using GIS? - How do we compare? - Are we efficient? - How can we improve delivery? - What should we do next? - Assessment / Justification - Waterfall, Vee, Spiral Models - Consolidation / Expansion - Effectiveness / Value
The Need to Assess Our GIS Capabilities Many organizations made very large investments in GIS: - Systems of Record - Systems of Operations - Systems of Engagement & Insight Many Enterprise GIS are now part of the Corporate DNA How well is your organization positioned to: - Sustain and protect your GIS investments? - Maximize the value from GIS for your customers, rate payers, owners - Take advantage of emerging technical capabilities? - Respond to new business drivers and opportunities?
2. Defining Capability Maturity Models (CMMs) CMM: - A methodology to improve an organization's software development capabilities. - Created at Carnegie Mellon University, Software Engineering Institute (SEI) in 1989 to objectively assess US-DOD government contractors. Applied in a number of application areas: - Systems Engineering - Project Management - Risk Management - Health - Banking - Information Technology Service Providers
CMM Maturity Levels Your organization s capability can be assessed in terms of the level of maturity of your development processes: Progressive: Organizations can improve over time Objective: Can benchmark vs. ideal case, or vs. other organizations Source: wikipedia
Basic CMM Methodology 1. Define measurement criteria 2. Define scoring system (5 levels) 3. Assess your organization 4. If benchmarking, get peer scores 5. Report and compare results (Table & Radar chart) Source: The Open Group (2012)
3. CMM for GIS (GIS CMM) A GIS CMM defines the typical properties of a capable and mature enterprise GIS organization. GIS CMM options you can consider: 1. SLIM GIM (Geographic Information Management) 2. PSD GMI (Public Sector Digest Geospatial Maturity Index) 3. URISA GIS CMM Self-Serve 4. URISA GIS CMM Assessment Service
Application of GIS CMMs 1. PSD-GMI: Canada: - Online: Survey Monkey - 146 Canadian muni s participated in 2018 - Results available online United States: - Survey closed two weeks ago - Results expected soon (online) 2. US FHWA and State DOTs: Used the URISA & Slim GIM Models Very good analysis. Worth a read if you are not a municipal government Need to customize GISCMM for your sector. 3. A number of other GIS examples (USA, Europe) Not discussed here.
4. The URISA GIS CMM Framework: Two Parts Enabling Capability (EC) Component: EC1. Framework GIS Data EC2. Framework GIS Data Maintenance EC3. Business GIS Data EC4. Business GIS Data EC5. GIS Data Coordination EC6. Metadata EC7. Spatial Data Warehouse EC8. Architectural Design EC9. Technical Infrastructure EC10. Replacement Plan EC11. GIS Software Maintenance EC12. Data back-up and security EC13. GIS Application Portfolio EC14. GIS Application Portfolio Management EC15. GIS Application Portfolio O&M EC16. Professional GIS Management EC17. Professional GIS Operations Staff EC18. GIS Staff Training and Professional Development EC19. GIS Governance Structure EC20. GIS is Linked to Agency Strategic Goals EC21. GIS Budget EC22. GIS Funding EC23. GIS Financial Plan Execution Ability (EA) Component: EA1. New Client Services Evaluation and Development EA2. User Support, Help Desk, and End-User Training EA3. Service Delivery Tracking and Oversight EA4. Service Quality Assurance EA5. Application Development or Procurement Methodology EA6. Project Management Methodology EA7. Quality Assurance and Quality Control EA8. GIS System Management EA9. Process Event Management EA10. Contract and Supplier Management EA11. Regional Collaboration EA12. Staff Development EA13. Operation Performance Management EA14. Individual GIS Staff Performance Management EA15. Client Satisfaction Monitoring and Assurance EA16. Resource Allocation Management EA17. GIS data sharing EA18. GIS Software License Sharing EA19. GIS data inter-operability EA20. Legal and policy affairs management EA21. Balancing minimal privacy with maximum data usage EA22. Service to the community and to the profession
Question Example Enabling Capability EC5. GIS Data Coordination EC6. Metadata EC7. Spatial Data Warehouse Is there an enterprise GIS data coordination function and/or committee to rationalize framework and business GIS data development, access, and maintenance? Is metadata available and maintained for all framework and business data layers? (Is there a rationale for accepting any data without metadata?) Is an enterprise spatial data infrastructure in place that includes a centralized production database environment available for GIS data stewards to compile the official version of framework and business spatial data?
5. Example of a GIS CMM Application: City of Vancouver GIS Strategic Plan (2015-16) Used the URISA GIS CMM as a starting point Performed a benchmark comparison with seven peers: Developed a 2-part self-assessment and peer questionnaire: 1. GIS Profile/Technical Architecture 2. Enabling Capability 3. Execution Ability 1. City of Ottawa, Ontario 2. City of Portland, Oregon 3. City and County of San Francisco, CA 4. City of Surrey, British Columbia 5. City of Calgary, Alberta 6. City of Rotterdam, Netherlands 7. City of Helsingborg, Sweden Administered using Survey Monkey and telephone follow-ups
Key Capabilities / GIS Architecture Current: 1. Field / Mobile Data Collection (staff input) 2. AVL / Vehicle Tracking (fleet input) 3. Responsive / 311 Crowdsourcing (public input) 4. Metadata / Data Discovery 5. Data Creation / Editing 6. Data Analysis 7. Cartography / Communication 8. Web-GIS Client Service(e.g., Parks, Crime) 9. Enterprise Applications 10. GIS Data Access / GIS Portal Service 11. Data Warehouse / Data Hub 12. Service-Oriented Architecture 13. Extract-Transform-Load (ETL) Toolsets 14. Open Data Access (Discovery / View / Download) Emerging: 1. Cloud-based Services 2. Business Intelligence 3. Advanced Visualization 4. 3D data models and analysis capabilities 5. Building Information Modelling (BIM) 6. Internet of Things / Sensor Web 7. Master Data Management (MDM) 8. Free and Open Source Software for GIS (FOSS4G)
Example Summary of Survey Monkey Peer Responses
Example of Results: Peer History, Architecture, GIS Support Organization Name GIS History GIS Architecture GIS Responsibility and Support (years) Desktop Departmental Enterprise (Centralized, Distributed, Hybrid) City of Ottawa 20 5 - Fully 5 - Fully 5 - Fully Centralized Implemented Implemented Implemented City of Portland, Oregon 25 5 - Fully 3 - In progress, 4 - In progress, full Hybrid USA Implemented partial resources resources City and County of San 15 5 - Fully 5 - Fully 5 - Fully Hybrid Francisco, California Implemented Implemented Implemented City of Surrey 20 5 - Fully 5 - Fully 5 - Fully Hybrid Implemented Implemented Implemented City of Calgary 15 5 - Fully -1 - Not required 5 - Fully Centralized Implemented Implemented City of Rotterdam 15-1 - Not required 3 - In progress, 3 - In progress, Distributed partial resources partial resources City of Helsingborg 23 3 - In progress, 3 - In progress, 3 - In progress, Centralized partial resources partial resources partial resources City of Vancouver 25 5 - Fully Implemented 3 - In progress, partial resources 3 - In progress, partial resources Hybrid
Example of Results: Comparison of GIS Architecture Capabilities
6. Lessons Learned GIS CMM provided a framework to: - Characterize Vancouver s As-Is Enterprise GIS capabilities - Benchmark with peers, and share experiences and insights - Identify gaps and opportunities for improvement - Communicate findings to senior management
Lessons Learned GIS CMM provides you with: - Extensive checklist topics and scoring scales as a starting point - A useful basis for assessing the current effectiveness of your investment in GIS GIS CMM can be: - Customized to meet your own needs - Linked to your Business Objectives & Architecture Vision - Used to communicate your GIS capabilities to senior management - Used to measure your organization s progress over time
Issues to Consider 1. Completing your first GISCMM can be time-consuming 2. Need to calibrate the participants to get meaningful results 3. How often should you do this? 4. CMM GIS must be customized for other domains (e.g., utilities) 5. Major growth in GIS CMM use by municipalities is very recent. Let s see if it has momentum.
Summary 1. Motivation for using a GIS CMM 2. Capability Maturity Models (CMM) 3. GIS CMM alternatives you can consider 4. The URISA GIS CMM 5. GIS CMM Example: City of Vancouver 6. Lessons Learned, Practical Issues
Key Sources Slim GIM: - www.slimgim.info URISA GIS CMM: - www.urisa.org/main/gis-management-institute/ PSD GMI: - publicsectordigest.com/geospatial-maturity-index-gmi
Thank You
2018 Esri Canada Limited. All rights reserved. Trademarks provided under license from Environmental Systems Research Institute, Inc. Other product and company names mentioned herein may be trademarks or registered trademarks of their respective owners. Errors and omissions excepted.