Ocean Teacher Global Academy (OTGA) Training Course on GIS Applications for Coastal Zone Management 28 August - 01 September, 2017

Transcription

1 Ocean Teacher Global Academy (OTGA) Training Course on GIS Applications for Coastal Zone Management 28 August - 01 September, 2017 N. Kiran Kumar Scientist-D & In-charge Web Based Services, INCOIS kirankumar@incois.gov.in International Training Centre for Operational Oceanography (ITCOocean) ESSO-INCOIS, Hyderabad, India International Oceanographic Data and Information Exchange

2 Overview GIS Basic Components Geographic Data Models & How data is used in ArcGIS GIS Types & available GIS Software s Components of ERDAS, ArcGIS ArcMap, ArcCatalog and ArcToolbox GIS on the Web ArcGIS Server, ArcGIS Online, Google Earth Extensions of ArcGIS Spatial Analyst, Geostatistical Analyst and 3D Analyst

3 A GIS integrates five basic components Methods Hardware Data People

4 GIS and maps What do you use maps for? What do you use GIS maps for?

5 Maps and layers A GIS uses layers to characterize and describe our world

6 Describing our World We can describe any element of our world in two ways: Spatial Information: Where is it? Attribute Information: What is it? Species: Oak Height: 15m Age: 75 Yrs 51 N, 112 W

7 Geographic Data Models All geographic information systems are built using formal models that describe how things are located in space. A formal model is an abstract and well-defined system of concepts. A geographic data model defines the vocabulary for describing and reasoning about the things that are located on the earth. Geographic data models serve as the foundation on which all geographic information systems are built. Scott Morehouse, Preface to Modeling our World

8 Data Models A geographic data model is a structure for organizing geospatial data so that it can be easily stored and retrieved. Geographic coordinates Tabular attributes

9 File-based Data Models Arc Geographic coordinates and attributes are stored in separate but linked files Info Coverages Developed for workstation Arc/Info ~ 1980 Complex structure, proprietary format Attributes in Info tables Shapefiles Developed for ArcView ~ 1993 Simpler structure in public domain Attributes in dbase (.dbf) tables

10 Storing Data Coverages Shapefiles Texas Texas Counties Evap Info Counties.shp Counties.shx Counties.dbf Evap.shp Evap.shx Evap.dbf

11 Storing Data Coverages and Shapefiles Coverages are stored partially in their own folder (ARC) and partially in the common INFO folder. Shapefiles are stored in three to five files (with extensions.shp,.shx,.dbf,.sbx and.sbn). Coverages store common boundaries between polygons only once, to avoid redundancy. Shapefiles store all the geometry of each polygon regardless of redundancy. Coverage features are single lines or single polygons. Shapefiles allow features to have multiple, disconnected, intersecting and overlapping components.

12 Geodatabase and Feature Dataset A geodatabase is a relational database that stores geographic information. A feature dataset is a collection of feature classes that share the same spatial reference frame.

13 Geodatabase model Stores geographic coordinates as one attribute (shape) in a relational database table Uses MS Access for Personal Geodatabase (single user) Shape Uses Oracle, SQL/Server, DB2 or other commercial relational databases for Enterprise Geodatabases (many simultaneous users) Uses files in File Geodatabase

14 Geodatabase Workspace Geodatabase Feature Dataset Feature Class Geometric Network Relationship Object Class

15 Object Class An object class is a collection of objects in tabular format that have the same behavior and the same attributes. An object class is a table that has a unique identifier (ObjectID) for each record

16 Feature Class A feature class is a collection of geographic objects in tabular format that have the same behavior and the same attributes. Feature Class = Object class + spatial coordinates

17 Relationship A relationship is an association or link between two objects in a database. A relationship can exist between spatial objects (features in feature classes), non-spatial objects (objects in object classes), or between spatial and non-spatial objects.

18 Relationship Relationship between non-spatial objects Water Quality Data Water Quality Parameters

19 Relationship Relationship between spatial and non-spatial objects Water quality data (non-spatial) Measurement station (spatial)

20 Network A network is a set of edges (lines) and junctions (points) that are topologically connected to each other. Each edge knows which junctions are at its endpoints Each junction knows which edges it connects to

21 What types of geographic data do you work with?

22 Vector model Geographic features are most commonly represented as points lines polygons Retail stores Streets Parcels Points Lines Areas/Polygons

23 Vector data organization Stored as feature classes Same geometry Same attributes Attributes for points Points Lines Polygons Shape field: Stores feature class geometry

24 Raster data model Used to represent imagery digital elevation models other thematic data

25 Raster data organization Matrix of cells Cell values measurements counts statistical values codes (4,5)

26 GIS Creating Our Future

27 GIS Types and Available GIS Software's Management and analysis - GIS statistical software uses standard database queries to retrieve data and analyze data for decision making. Web Application Programming Interface (API) is a set of subroutines designed to manage GIS data for its delivery to a web browser client from a GIS server using scripting language such as VBA or JavaScript. Distributed GIS are web-based GIS, Mobile GIS, Corporate GIS and GRID computing. Mobile GIS - implementations on mobile devices. With the widespread adoption of GPS, GIS has been used to capture and integrate data in the field.

28 Open-source GIS Software freely available over Internet downloads. They adopt OGC standards for networked servers, development of open source software continues to evolve, especially for web and web service oriented applications. Well-known open source GIS software includes GRASS GIS, Quantum GIS, MapServer, udig, OpenJUMP, gvsig and many others. PostGIS provides an open source alternative to geo-databases such as Oracle Spatial, and ArcSDE- proprietary and open data formats such as the Shape File format for vector data and the Geotiff format. Web mapping Google Maps, and Live Maps give the public access to street maps and aerial/satellite imagery that support such features as geocoding, searches, and routing functionality. MapInfo's MapXtreme, Intergraph's GeoMedia WebMap, ESRI's ArcIMS, ArcGIS Server, Auto Desk's Mapguide and the open source MapServer offer users to create custom applications.

29 Open Geospatial Consortium (OGC) Standards Open Geospatial Consortium (OGC) is an international industry consortium of companies, government agencies and universities to develop publicly available geo-processing specifications. Open interfaces and protocols (Web Map Service (WMS) and Web Feature Service (WFS)) defined by Open GIS Specifications support interoperable solutions that enable the Web, wireless and location based services, and mainstream IT, and empower technology developers to make complex spatial information and services.

30 Commercial or proprietary GIS software ESRI Products include ArcView 3.x, ArcGIS, ArcSDE, ArcIMS, and ArcWeb services. GRAM++ GIS Low-cost GIS software product developed by CSRE, IIT Mumbai. Autodesk MapGuide and other products that interface with its AutoCAD software package. Cadcorp Developers of GIS software and OpenGIS standard Intergraph GeoMedia, GeoMedia Profesional, GeoMedia WebMap ERDAS IMAGINE GIS, Remote Sensing, and Photogrammetry software by Leica Geosystems Geospatial Imaging. IDRISI GIS developed by Clark Labs. MapInfo MapInfo Professional and MapXtreme. integrates GIS software, data and services.

31 Commercial or proprietary GIS software MapPoint GIS product developed by Microsoft. Caliper Maptitude, TransCAD and TransModeler for transportation. CARIS (Computer Aided Resource Information System) for hydrography and cadastral systems. GMS Three-dimensional environment for building geologic and groundwater models TatukGIS Products include a GIS development toolkit, Internet Map Server, GIS Editor, free GIS Viewer, Aerial Imagery Corrector. Axpand cartography product by Axes Systems for data import/export, automatic generalization, visualization and on-screen editing, pre-print configuration.

32 Open source software GRASS U.S. Army Corps of Engineers, open source: a complete GIS MapServer Web-based mapping server, by the University of Minnesota. QGIS - is a cross-platform free and open-source desktop geographic information system (GIS) application that supports viewing, editing, and analysis of geospatial data. Chameleon Environments for building applications with MapServer. GeoNetwork open source A catalog application to manage spatially referenced resources ILWIS (Integrated Land and Water Information System) integrates image, vector and thematic data. MapWindow GIS Free, open source GIS desktop application and programming component.

33 Other GIS software PostGIS Spatial extensions for the open source PostgreSQL database, allowing geospatial queries. TerraView GIS desktop that handles vector and raster data stored in a relational or geo-relational database. AccuGlobe Fully functional GIS and geoanalysis software platform for Windows developed by DDTI (ddti.net) CrossView for ArcGIS created by A-Prime Software, is a wizard based ArcGIS plug-in, which enables map cross-sectioning and profile creation. GeoBase developed by Telogis. focus on real-time processing for reversegeocoding, geofencing, My World GIS GIS platform for Windows and Mac OSX with robust/intuitive geoprocessing tools, Panorama Russian GIS for military uses. SPRING GIS software developed at INPE SavGIS Free and complete GIS software available in French, English

34 GIS Software

35 Components of ERDAS, ArcGIS ArcMap, ArcCatalog and ArcToolbox

36 Hexagon Geospatial - Products and Platform Desktop Cloud - ERDAS Imagine - GeoMedia - Photogrammetry - All Server & Mobile Products Apollo Products Web Map Products GeoMedia Smart Client Mobile Products - Smart M.Apps

37 ERDAS IMAGINE Overview A powerful authoring platform to turn your geospatial data into actionable information. A proven leader in Remote Sensing, Radar & Point Cloud Analysis. Single platform to access optical, aerial, UAV, Radar, Hyperspectral, Thermal, Vector, Elevation & Scientific data Performs advanced remote sensing analysis and spatial modelling to create new information. Visualize your results in 2D, 3D, movies, and on cartographicquality map compositions. Optional modules (add-ons) provide specialized functionalities to enhance your productivity and expand capabilities.

38 Key Features ERDAS IMAGINE Mosaic images of unlimited size Image classification using vast algorithms Different Change detection techniques Image enhancement & filtering Vegetation, Soil & Mineral indices Hyperspectral data analysis Scientific & Radar data analysis Map Composition & presentation Spatial & Spectral Tools Terrain Analysis Dynamic spatial model Creation & Visualization of Results Python & IMAGINE Command Line support in Spatial Models Access & analyse point cloud (lidar) data

39 ArcGIS a long history A Pervasive System for Using Maps & Geographic Information ArcGIS 10.x ArcGIS

40 ArcGIS as a platform Provides Geospatial Capabilities Across the Entire Organization Mapping Analysis Visualization Managers Knowledge Workers Citizens Deployed Users Enterprise Integration Cloud Professional GIS... A Framework For Sharing, and Collaboration

41 Integrate ArcGIS for Desktop capability Authoring authoritative content Mapping Editing Editor Tom Bill Joe Visualization Analysis ¼ Mile ½ Mile 1 Mile

42 ArcGIS DESKTOP Platform for - Creating, - Editing, and - Analyzing geographic knowledge - Examine relationships, - Test predictions - Ultimately make better decisions. Managing Data Analyzing Visualizing Design & Planning Decision Making Measuring Acting

43 ArcGIS DESKTOP ArcMap Mapping, editing, visualization, and analysis Arc Catalog Browse and display data, Manage data and Search for data ArcToolbox perform analysis

44 ArcMap: Mapping application

45 Feature classes and layers Each layer references a feature class (data) Layers define the appearance of the data

46 Feature class organization Each feature class contains a set of features and attributes Each feature has one record Businesses Streets Businesses attribute table Zoning

47 How is geographic data stored? Geodatabase Primary storage mechanism in ArcGIS Geodatabase with feature classes, a raster dataset, and a stand-alone table

48 Arc Catalog: Data management application Catalog Tree View Contents Panel Right-click an item to view its shortcut menu

49 Consider Do you want to see all the layers in your map all the time? Do you want to see all the features in a layer all the time? What are some ways to control the display of layers and features in ArcMap?

50 Zooming using commands and tools Zoom to Layers Selections Bookmarks Full extent Zoom to selected features

51 Controlling which features display Definition query Query statement defines which features draw Query statement: Attribute field: "SQKM" Operator: > Value: 500 "SQKM" > 500 All lakes are displayed Only lakes larger than 500 square kilometers are displayed

52 Controlling when layers display Scale range Layer turns on or off when scale threshold is crossed Railroads don t display when zoomed out Railroads display when zoomed in to a specified scale 1:5,000,000 1:3,000,000

53 Grouping layers Thematically related layers grouped in the table of contents When Transportation is unchecked, member layers do not draw

54 Creating basemap layers Lakes, Provinces, Countries, and Ocean make up the Basemap layer

55 Making new map layers Create selection layer Left: Parks with lakes are selected Right: Selected parks are saved as new layer Parks Parks Selection Parks

56 What is Symbology?

57 Symbology based on attributes Category: State Name Quantity: Population

58 Categorical data Names Codes Descriptions

59 What is Quantitative data?

60 Quantitative data Count Measurement ELEV

61 Quantitative data Density: POP2001 / SQKM

62 Quantitative symbology based on attributes Colors associated with elevation values ELEV Symbol size associated with population values

63 What is classification and why do we need it?

64 Classification methods Natural Breaks Equal Interval People per sq km People per sq km Quantile Manual People per sq km People per sq km

65 Classification methods Natural Breaks Note: Value 0 indicates less than one person per square kilometer.

66 Classification methods Equal Interval: 0-6; 7-12; 13-18; Note: Value 0 indicates less than one person per square kilometer.

67 Classification methods Quantile Note: Value 0 indicates less than one person per square kilometer.

68 Classification methods Manual: Depends on what you want to show Suppose you want to show Provinces with < or > 10 people per sq km Note: Value 0 indicates less than one person per square kilometer.

69 Where does map text come from?

70 What are labels? Software-generated map text based on attribute values

71 Dynamic label placement Preferred label position is top right 1 2 Positions vary, but all labels fit Mississauga and St. Catharines suppressed to avoid conflict 3

72 Placement rules for different feature types Points Lines Polygons Prefer Top Right, all allowed Curved and Above Line Horizontal

73 Label symbology Font, size, color, more Arial, 14-point, Bold, Purple Heart Character spacing White 2-point halo

74 SQL query Draw labels only for specified attribute values Example: Label only international airports "DESCRIPT" = 'International'

75 Scale range Draw labels at specified scales Example: Label airports only at large scales Scale > 1:2,000,000 Scale < 1:2,000,000

76 Label classes Additional sets of labels for a layer Typically use different symbology Two label classes based on population

77 Label expressions Use scripting functions to format labels [NAME] Label expression: &vbnewline & "<FNT size='8'>" & "Population" & "</FNT>" &vbnewline & "<CLR red= '168' green= '0' blue='0'>" & [CSD_POP01] & "</CLR>"

78 Ranks and weights Label weight ranking Ordered label classes by priority Assign weight to features and labels (in case of conflict)

79 Map Layout - content considerations Purpose Create map of national park mountain peaks Situation Map will be hung at various park locations and used in map booklets Audience Park visitors, backpackers, rangers, park naturalists, park maintenance staff

80 Data View vs. Layout View Data View Layout View

81 Map elements Title Legend Border Main map Locator map Locator map Logo Scale bar North arrow

82 ArcGIS DESKTOP Ecological Sampling Enables Better Analysis Advancing Geographic Science Integrated Scientific Programming 3D Analysis Statistics Python GIS Time-Aware Analysis & Visualization Math Modeling Background Processing Improved Map Algebra Location & Allocation... Extending Our Quantitative Methods

83 ArcGIS DESKTOP Complete 3D GIS 3D Analysis 3D Editing Fast Visualization Virtual Cities Terrain Updating Video Integration 3D Models - Providing Powerful Data Management, Analysis & Visualization... Removing Limitations & Dramatically Improving Performance

84 ArcGIS DESKTOP Supports time based visualisation New York Katrina Sea Ice... Creating Greater Understanding

85 ArcGIS DESKTOP Applications with 3D Functionality ArcGlobe ArcScene ArcMap ArcCatalog

86 ArcGIS Pro Professional GIS App for the ArcGIS Platform ArcMap & ArcGIS Pro Apps Esri s next-gen 64-bit desktop GIS product is ArcGIS Pro. Technologically ahead of everything else on the market. WebGIS ArcGIS Pro provides professional 2D and 3D mapping in an intuitive user interface. You can think of ArcGIS Pro as a big step forward - one that advances visualization, analytics, image processing, data management, and integration. Desktop Key Features 700+ Geo processing and Analysis Tools Share maps and data Seamlessly work in both 2D and 3D Multiple Layouts Fully integrated with ArcGIS Platform Configure UI through settings, and workflow through Tasks Automate using geoprocessing and Python Extend with the Pro SDK Advanced Mapping, Visualization, Editing and Analysis New and Improved Smart Mapping Editing KML/WFS Map Series Charting

87 GIS on the Web ArcGIS Server, ArcGIS Online, Google Earth, Arc Earth

88 WebGIS Empowers Everyone in Your Organization To Discover, Use, Make, and Share Maps from Any Device, Anywhere, Anytime Making it Easy for Everyone to See How Geography Influences Their Decisions

89 ArcGIS Enterprise Next Generation Server Platform (10.5) App s Access and Management Desktop APIs Portal Portal Data Management, Mapping, and Geoprocessing Real Time GIS Server GeoEvent Server Image Server GeoAnalytics Server Image Management & Raster Analytics Big Data ArcGIS Enterprise Deployable On-Premises and In the Cloud Enterprise Data Management, Analysis, and Mapping

90 ArcGIS for Server enables Web GIS in your infrastructure Desktop Web Device Client applications E.g.: Collector, Dashboard, Explorer, Esri Maps for Apps, and Web AppBuilder Apps Portal Portal for ArcGIS Includes data from ArcGIS Online portal Server Online Content and Services GIS Servers GIS server ArcGIS Web Adaptor, Enterprise geodatabase, ArcGIS Data Store

91 What are GIS services? GIS service GIS resource running on a server -vs. GIS application on your local computer Share GIS resource to the web services Map Feature Network Geodata Geoprocessing Image Locator Schematics

92 ArcGIS API for Python Enables Scripting and Automation A Whole New Way to Experience and Leverage ArcGIS Command Line Automation Analysis Command Line Scripts Jupyter Notebooks System Administration Python API ArcGIS (Enterprise & Online) Programmatic Access to ArcGIS Jupyter Notebooks Scripts Empowering GIS Users... And Opening ArcGIS to Data Scientists

93 Geographic Web Browser- Google Earth Google Maps is a free web mapping service by Google that provides various types of geographical information. Using Google Maps, one can. Search for places or get directions from one place to another. View and navigate through horizontal and vertical panoramic street level images of various cities around the world. Get specific information like traffic at a particular point. Google Maps provides an API using which you can customize the maps and the information displayed on them.

94 Geographic Web Browser- Google Earth Google Maps ( = The passive side of Google Maps Allows you to view the basic Google Map content. Search for addresses, businesses, places of interest, etc. Base maps: Traffic layer, Map layer, Satellite Layer, Terrain Layer, Earth Layer. Activate Street View by clicking on the orange person and dragging it around the map. Google My Maps ( and click on: My Maps) = The interactive side of Google Maps Create your own content (= your own personal maps), complete with imbedded photographs and YouTube videos. Please note: Google My Maps requires a free Google Account. Browse and use the interactive content created by others. Perform some basic quantitative analysis. Share your maps and content with others.

95 Google Earth 3D With Terrain

96 Adding data to Google Earth

97 ArcGIS Earth ArcGIS Earth is a simple, lightweight, easy-to-use desktop application that allows you to display and explore a variety of 3D and 2D map data for any part of the world. Build skills in these areas: Navigating and exploring ArcGIS Earth Changing the basemap Finding data in the Living Atlas Adding data from a file Sharing your results Explore the world with ArcGIS Earth

98 Extensions of ArcGIS Spatial Analyst, Geostatistical Analyst and 3D Analyst

99 ArcGIS DESKTOP Defense Extensions - Providing Specialized Capabilities Spatial Analysis Logistics Network Analysis 3D Analysis & Visualization Schematics Tracking Publishing Interoperability Survey Business Solutions Business Analytics Workflow Transportation Logistics Map & Data Production Workflow Management Geospatial Intelligence Production Mapping Aeronautical Nautical Mapping Agency Defense Mapping

100 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Spatial Analyst Suitability Modeling Use ArcGIS Spatial Analyst to select the best location for a new site. Surface Analysis Build and analyze complex surfaces to identify patterns or features. Distance Analysis Calculate the cost of travel, costweighted distance, least-cost path, and shortest path Density Analysis Calculate a density value for each cell in an output raster. Statistical Analysis Apply cell, neighborhood, zonal overlay, and multivariate statistical analysis techniques to the modeling of your spatial data. Solar Radiation Value Wh/m2 High : Low :

101 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Network Analyst Routing - Multipoint routing - Time windows supported on stops - Traveling salesperson Vehicle Routing Problem - Time windows - Driver breaks and specialties - Vehicle capacities and order quantities Service Areas - Complex polygon generation - Allocation across networks Closest Facility - Fixed and mobile asset routing - Emergency response OD Cost Matrix - Travel time matrix - Maximum destination and distance cutoffs Route Closest Facility Service Area Vehicle Routing Origin-Destination Location-Allocation Problem Cost Matrix

102 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities 3D Analyst Data Visualization - Three-dimensional visualization of your GIS data for data exploration and synthesis Interactive Navigation - Interactive navigation tools to explore, display, and query your three-dimensional data Surface Creation and Analysis - Creation and analysis of surface data for sophisticated modeling, viewing, and analysis 3D Symbols - Support for hundreds of three-dimensional symbols to enhance the display and realism of your data Fly-through Paths and Animations - Creation of advanced fly-throughs and animations for better communication and presentation of important concepts Surface Creation and Analysis 3D Visualisation and Analysis

103 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Geostatistical Analyst Visualize, model, and predict spatial relationships. Link data, graphs, and maps dynamically. Perform deterministic and geostatistical interpolation. Evaluate models and predictions probabilistically assess risks. s 1 s 2 Moving window direction s n Semivario gram for s 1 Semivario gram for s 2 Semivario gram for s n

104 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Data Interoperability - Read more than 100 spatial data formats - including GML, XML, WFS, Autodesk DWG/DXF, MicroStation Design, MapInfo MID/MIF and TAB, Oracle and Oracle Spatial, and Intergraph GeoMedia Warehouse. - Share data with anyone - by exporting to more than 70 spatial data formats. - Build complex spatial ETL processes - using FME Workbench, a semantic data translation engine for data transformation, migration, validation, and distribution. - Incorporate these formats and ETL processes - in the geoprocessing framework using tools, ModelBuilder, and scripts

105 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Schematics Automatically generate schematics from complex networks. Check network connectivity. Perform quality control of network data. Optimize network design and analysis. Evaluate network forecast and planning (modeling, simulation, comparative analysis). Dynamically interact with GIS through a schematic view. Perform commercial and market analyses. Model social networks, generate flowcharts, and manage interdependencies.

106 ArcGIS DESKTOP Extensions - Providing Specialized Capabilities Tracking Analyst Visualize change over time. Symbolize the age of data by color, size, or shape. Group and symbolize data by entity or track. Interactively play back time-based data. Analyze historical or real-time data. Create animation files for AVI output.

107 Useful Resources Software s: ArcGIS Products: Google Maps Tutorials: General: ArcGIS Blog: GeoNet: Reference material and brochures about ESRI products: ArcGIS summary: Spatial Analyst summary: ESRI Virtual Campus provides online training:

108 Useful Resources GIS Data for Global Datasets: Name Description Natural Earth Global Map GSHHG Global Administrative Areas Gridded Population of the World (GPW) Global Roads Open Access Data Set (groads) OpenStreetMap Shaded relief data Bhuvan Earth Explorer ArcGIS Open Data

109 Courtesy: Contents, images used in this presentation are from &